Jul 23 03:11:21 devstack cinder-volume[77395]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:11:21 devstack cinder-volume[77395]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:11:21 devstack cinder-volume[77395]: we strongly recommend against using it for new projects. Jul 23 03:11:21 devstack cinder-volume[77395]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:11:21 devstack cinder-volume[77395]: framework. For more detail see Jul 23 03:11:21 devstack cinder-volume[77395]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:11:21 devstack cinder-volume[77395]: import eventlet # noqa Jul 23 03:11:24 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:11:24 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:11:24 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:11:24 devstack cinder-volume[77395]: INFO dbcounter [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Registered counter for database cinder Jul 23 03:11:24 devstack cinder-volume[77395]: DEBUG oslo_db.sqlalchemy.engines [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:25 devstack cinder-volume[77395]: DEBUG dbcounter [-] [77395] Writer thread running {{(pid=77395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:25 devstack cinder-volume[77395]: INFO cinder.rpc [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:11:25 devstack cinder-volume[77395]: INFO cinder.rpc [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:11:25 devstack cinder-volume[77395]: DEBUG oslo_db.sqlalchemy.engines [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:25 devstack cinder-volume[77395]: INFO cinder.volume.manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Determined volume DB was empty at startup. Jul 23 03:11:25 devstack cinder-volume[77395]: DEBUG cinder.volume.manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77395) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:11:25 devstack cinder-volume[77395]: INFO cinder.volume.manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:11:25 devstack cinder-volume[77395]: WARNING stevedore.named [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:25 devstack cinder-volume[77395]: WARNING castellan.key_manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:25 devstack cinder-volume[77395]: WARNING cinder.keymgr.conf_key_mgr [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:25 devstack cinder-volume[77395]: DEBUG cinder.volume.drivers.lvm [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77395) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 23 03:11:25 devstack cinder-volume[77395]: DEBUG oslo_concurrency.processutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_concurrency.processutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] CMD "cinder-rtstool verify" returned: 0 in 0.562s {{(pid=77395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_db.sqlalchemy.engines [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:26 devstack cinder-volume[77395]: INFO cinder.rpc [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 03:11:26 devstack cinder-volume[77395]: INFO cinder.rpc [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 23 03:11:26 devstack cinder-volume[77395]: WARNING stevedore.named [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:26 devstack cinder-volume[77395]: WARNING castellan.key_manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:26 devstack cinder-volume[77395]: INFO cinder.volume.manager [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_db.sqlalchemy.engines [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:26 devstack cinder-volume[77395]: INFO oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Starting 1 workers Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Started child 77565 {{(pid=77395) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Full set of CONF: {{(pid=77395) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] ******************************************************************************** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Configuration options gathered from: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] ================================================================================ {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] allow_availability_zone_fallback = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] allow_compression_on_image_upload = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] allowed_direct_url_schemes = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] api_rate_limit = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] auth_strategy = keystone {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77565]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] az_cache_duration = 3600 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_availability_zone = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_host = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_stats_polling_interval = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backup_api_class = cinder.backup.api.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backup_name_template = backup-%s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backup_use_same_host = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backup_use_temp_snapshot = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] chap_password = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] chap_username = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_internal_tenant_project_id = ed5905293f2a40ac993e1168965afadc {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_internal_tenant_user_id = 485e1fbbd6174ee1bce4387cfe59c95d {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cloned_volume_same_az = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cluster = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] compression_format = gzip {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] compute_api_class = cinder.compute.nova.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] config_dir = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] config_source = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] control_exchange = openstack {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] debug = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] default_availability_zone = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] default_group_type = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] default_volume_type = lvmdriver-1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] disk_geometry = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_client_cert = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_client_cert_key = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_data_namespace = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_ssl_cert_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_ssl_cert_verify = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] driver_use_ssl = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] enable_force_upload = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] enable_new_services = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] enable_unsupported_driver = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] enabled_backends = ['lvmdriver-1'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] enforce_multipath_for_image_xfer = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] filter_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_api_insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_api_ssl_compression = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_ca_certificates_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_catalog_info = image:glance:publicURL {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_num_retries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance_request_timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] goodness_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] graceful_shutdown_timeout = 5 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] group_api_class = cinder.group.api.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] host = devstack {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_compress_on_upload = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_conversion_address_space_limit = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_conversion_cpu_limit = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_conversion_disable = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_upload_use_cinder_backend = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_upload_use_internal_tenant = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_volume_cache_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_volume_cache_max_count = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] image_volume_cache_max_size_gb = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] init_host_max_objects_retrieval = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] instance_format = [instance: %(uuid)s] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iscsi_target_flags = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iscsi_write_cache = on {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iser_helper = tgtadm {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iser_ip_address = 192.168.122.7 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iser_port = 3260 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_color = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_config_append = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_dir = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_options = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_rotate_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_rotate_interval_type = days {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] log_rotation_type = none {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] max_age = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] max_logfile_count = 30 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] max_logfile_size_mb = 200 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] max_over_subscription_ratio = 20.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] message_reap_interval = 86400 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] message_ttl = 2592000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] migration_create_volume_timeout_secs = 300 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] monkey_patch = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] monkey_patch_modules = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] my_ip = 192.168.122.7 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] no_snapshot_gb_quota = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] num_iser_scan_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] num_shell_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77565]: INFO cinder.volume.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] num_volume_device_scan_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] nvmeof_conn_info_version = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] nvmet_ns_id = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] nvmet_port_id = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_max_limit = 1000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_ext_list = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_listen = 0.0.0.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_listen_port = 8776 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_use_ssl = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] osapi_volume_workers = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] per_volume_size_limit = -1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] periodic_fuzzy_delay = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] periodic_interval = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] project_id_regex = [0-9a-f\-]+ {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] public_endpoint = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] publish_errors = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_backup_gigabytes = 1000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_backups = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_gigabytes = 1000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_groups = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_snapshots = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] quota_volumes = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] rate_limit_burst = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] rate_limit_except_level = CRITICAL {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] rate_limit_interval = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] reinit_driver_count = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] replication_device = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] report_discard_supported = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] report_interval = 120 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] reservation_clean_interval = 86400 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] reservation_expire = 86400 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] reserved_image_namespaces = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] reserved_percentage = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] rpc_response_timeout = 120 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] run_external_periodic_tasks = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] scst_target_driver = iscsi {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] scst_target_iqn_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_down_time = 720 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] shell_completion = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] snapshot_name_template = snapshot-%s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] snapshot_same_host = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] split_loggers = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] state_path = /opt/stack/data/cinder {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] storage_availability_zone = nova {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] storage_protocol = iSCSI {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] syslog_log_facility = LOG_USER {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_helper = lioadm {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_ip_address = 192.168.122.7 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_port = 3260 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_protocol = iscsi {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] target_secondary_ip_addresses = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] trace_flags = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] transfer_api_class = cinder.transfer.api.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] transport_url = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] until_refresh = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_chap_auth = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_default_quota_class = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_journal = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_json = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_multipath_for_image_xfer = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_stderr = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] use_syslog = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] verify_glance_signatures = enabled {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_api_class = cinder.volume.api.API {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_backend_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_clear = zero {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_clear_ionice = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_clear_size = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_copy_bps_limit = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_dd_blocksize = 1M {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_name_template = volume-%s {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_service_inithost_offload = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volume_usage_audit_period = month {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] zoning_mode = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_concurrency.disable_process_locking = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.auth_section = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.auth_type = password {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.auth_version = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.cache = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.include_service_catalog = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.interface = public {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_password = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcache_username = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.region_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.service_token_roles_required = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.service_type = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.backend = dogpile.cache.null {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.backend_argument = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.backend_expiration_time = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.config_prefix = cache.oslo {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.debug_cache_backend = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.enable_retry_client = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.enable_socket_keepalive = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.expiration_time = 600 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.hashclient_retry_attempts = 2 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_dead_retry = 300 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_pool_maxsize = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_sasl_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.password = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.proxies = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.redis_db = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.redis_server = localhost:6379 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.retry_attempts = 2 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.retry_delay = 0.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.socket_keepalive_count = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.socket_keepalive_idle = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.socket_keepalive_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.socket_timeout = 1.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.tls_allowed_ciphers = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.tls_cafile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.tls_certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.tls_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.tls_keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cache.username = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] coordination.backend_url = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.asyncio_connection = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.asyncio_slave_connection = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.backend = sqlalchemy {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.connection = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.connection_debug = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.connection_parameters = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.connection_recycle_time = 3600 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.connection_trace = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.db_inc_retry_interval = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.db_max_retries = 20 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.db_max_retry_interval = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.db_retry_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.max_overflow = 50 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.max_pool_size = 5 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.max_retries = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.mysql_wsrep_sync_wait = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.pool_timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.retry_interval = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.slave_connection = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.sqlite_synchronous = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.synchronous_reader = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] database.use_db_reconnect = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.connection_string = messaging:// {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.es_doc_type = notification {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.es_scroll_size = 10000 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.es_scroll_time = 2m {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.filter_error_trace = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.hmac_keys = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.sentinel_service_name = mymaster {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.socket_timeout = 0.1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.trace_requests = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler.trace_sqlalchemy = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler_jaeger.process_tags = {} {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler_jaeger.service_name_prefix = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] profiler_otlp.service_name_prefix = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.enforce_new_defaults = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.policy_default_rule = default {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.policy_file = policy.yaml {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_policy.remote_timeout = 60.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.group = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.helper_command = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] privsep_osbrick.user = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.group = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.helper_command = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] cinder_sys_admin.user = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.auth_section = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.auth_type = password {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.cafile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.collect_timing = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.send_service_user_token = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.split_loggers = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] service_user.timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.auth_section = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.auth_type = password {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.collect_timing = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.region_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.split_loggers = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] glance.timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.backend_availability_zone = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.chap_password = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.chap_username = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.disk_geometry = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_client_cert = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_client_cert_key = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_data_namespace = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.driver_use_ssl = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack sudo[77622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.extra_capabilities = {} {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.filter_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.goodness_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack sudo[77622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iscsi_target_flags = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iscsi_write_cache = on {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iser_helper = tgtadm {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iser_port = 3260 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.lvm_mirrors = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.lvm_share_target = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.lvm_type = auto {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.num_shell_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.replication_device = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.report_discard_supported = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.reserved_percentage = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_helper = tgtadm {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_port = 3260 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_protocol = iscsi {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.trace_flags = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.unique_fqdn_network = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.use_chap_auth = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_backend_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_clear = zero {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_clear_ionice = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_clear_size = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volume_group = cinder-volumes {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_reports.file_event_handler = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_reports.log_dir = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.backend_availability_zone = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.backend_host = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.chap_password = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.chap_username = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.chiscsi_conf = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.disk_geometry = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_client_cert = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_data_namespace = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.driver_use_ssl = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.extra_capabilities = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.filter_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.goodness_function = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iser_helper = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iser_ip_address = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iser_port = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.iser_target_prefix = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.lvm_conf_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.lvm_mirrors = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.lvm_share_target = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.lvm_type = auto {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.num_shell_tries = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.nvmet_port_id = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.replication_device = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.report_discard_supported = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.reserved_percentage = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.scst_target_driver = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.storage_protocol = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_helper = lioadm {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_ip_address = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_port = 3260 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_protocol = iscsi {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.trace_flags = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.use_chap_auth = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_clear = zero {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_clear_size = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] lvmdriver-1.volumes_dir = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.ssl_version = {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_notifications.driver = [] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_notifications.retry = -1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] key_manager.fixed_key = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.barbican_api_version = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.barbican_endpoint = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.barbican_endpoint_type = public {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.barbican_region_name = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.cafile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.collect_timing = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.number_of_retries = 60 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.retry_delay = 1 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.send_service_user_token = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.split_loggers = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.verify_ssl = True {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican.verify_ssl_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.auth_section = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.auth_type = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.cafile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.certfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.collect_timing = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.insecure = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.keyfile = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.split_loggers = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] barbican_service_user.timeout = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.approle_role_id = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.approle_secret_id = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.auth_method = approle {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.auth_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.kv_mountpoint = secret {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.kv_path = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.kv_version = 2 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.namespace = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.root_token_id = **** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.ssl_ca_crt_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.timeout = 60.0 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.token_file = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.token_role = None {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.use_ssl = False {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:26 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] ******************************************************************************** {{(pid=77395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:11:26 devstack sudo[77622]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[77730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:26 devstack sudo[77730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack sudo[77730]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.247s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:11:26 devstack cinder-volume[77565]: INFO cinder.brick.local_dev.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[77825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:26 devstack sudo[77825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:27 devstack sudo[77825]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:27 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77565]: DEBUG cinder.brick.local_dev.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77565) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 23 03:11:27 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack sudo[77926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:27 devstack sudo[77926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[77926]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.535s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[78244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:28 devstack sudo[78244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78244]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 23 03:11:29 devstack sudo[78311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78311]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78314]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78317]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78320]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:30 devstack sudo[78323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78323]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:30 devstack sudo[78327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78327]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77565]: INFO cinder.volume.drivers.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:30 devstack sudo[78331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78331]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78342]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78346]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:31 devstack sudo[78349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78349]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78354]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77565]: INFO cinder.volume.driver [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG cinder.volume.driver [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77565) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_db.sqlalchemy.engines [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writer thread running {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG cinder.db.api [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Building query based on filter {{(pid=77565) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG cinder.image.image_utils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77565) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:11:32 devstack cinder-volume[77565]: INFO cinder.keymgr.migration [None req-b20a3fab-6db9-4669-875a-2301e7d12933 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:32 devstack sudo[78357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78357]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:32 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:32 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:32 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:32 devstack sudo[78363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:32 devstack sudo[78363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:33 devstack sudo[78363]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:33 devstack sudo[78367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:33 devstack sudo[78367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:33 devstack sudo[78367]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG cinder.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Notifying Schedulers of capabilities ... {{(pid=77565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:11:33 devstack cinder-volume[77565]: INFO cinder.volume.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Driver initialization completed successfully. Jul 23 03:11:33 devstack cinder-volume[77565]: INFO cinder.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Initiating service 2 cleanup Jul 23 03:11:33 devstack cinder-volume[77565]: INFO cinder.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Service 2 cleanup completed. Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG cinder.service [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Creating RPC server for service cinder-volume {{(pid=77565) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG cinder.service [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77565) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:11:33 devstack cinder-volume[77565]: INFO cinder.volume.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:33 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:33 devstack sudo[78375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:33 devstack sudo[78375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78375]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:34 devstack sudo[78474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78474]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:34 devstack sudo[78493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78493]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:34 devstack sudo[78559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:34 devstack sudo[78559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:34 devstack sudo[78559]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:34 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:34 devstack cinder-volume[77565]: INFO cinder.volume.manager [None req-5172ca41-0028-4037-b567-5aa34a7f1679 None None] Driver post RPC initialization completed successfully. Jul 23 03:11:36 devstack cinder-volume[77395]: DEBUG dbcounter [-] [77395] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:12:06 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager._thread_info {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:12:06 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread count: 6 {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:12:06 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread info: [<_MainThread(MainThread, started 128239651287168)>, , , , , ] {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:13:06 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:06 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:13:06 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:06 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:13:06 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:07 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:07 devstack sudo[83574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:07 devstack sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:07 devstack sudo[83574]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:07 devstack sudo[83579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:13:07 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:07 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:07 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:07 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:07 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG cinder.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Notifying Schedulers of capabilities ... {{(pid=77565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager._thread_info {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread count: 6 {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:13:07 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread info: [<_MainThread(MainThread, started 128239651287168)>, , , , , ] {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:13:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:SELECT=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:13:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:UPDATE=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:14:06 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:14:06 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:14:06 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:06 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:14:06 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:07 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:07 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:07 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:07 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:07 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:14:07 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:07 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:07 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:07 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:07 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:07 devstack cinder-volume[77565]: DEBUG cinder.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Notifying Schedulers of capabilities ... {{(pid=77565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:14:08 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager._thread_info {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:14:08 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread count: 6 {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:14:08 devstack cinder-volume[77565]: DEBUG cinder.volume.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] thread info: [<_MainThread(MainThread, started 128239651287168)>, , , , , ] {{(pid=77565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:15:06 devstack cinder-volume[77565]: DEBUG oslo_service.periodic_task [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:15:06 devstack cinder-volume[77565]: DEBUG cinder.volume.drivers.lvm [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Updating volume stats {{(pid=77565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:15:06 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:06 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:15:06 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:07 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:07 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:07 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:07 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:07 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:15:07 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:07 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:07 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:07 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:07 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG oslo_concurrency.processutils [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:07 devstack cinder-volume[77565]: DEBUG cinder.manager [None req-1410518b-e8d2-486a-8be4-9425b95695bf None None] Notifying Schedulers of capabilities ... {{(pid=77565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:15:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:SELECT=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:15:44 devstack cinder-volume[77565]: DEBUG dbcounter [-] [77565] Writing DB stats cinder:UPDATE=1 {{(pid=77565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:15:55 devstack cinder-volume[77395]: INFO oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Caught SIGTERM, stopping children Jul 23 03:15:55 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Acquiring lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:55 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Acquired lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:55 devstack cinder-volume[77395]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Releasing lock "singleton_lock" {{(pid=77395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:55 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Stop services. {{(pid=77395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:15:55 devstack cinder-volume[77395]: DEBUG oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Killing children. {{(pid=77395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:15:55 devstack cinder-volume[77395]: INFO oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Waiting on 1 children to exit Jul 23 03:15:58 devstack cinder-volume[77565]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Acquiring lock "singleton_lock" {{(pid=77565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:58 devstack cinder-volume[77565]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Acquired lock "singleton_lock" {{(pid=77565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:58 devstack cinder-volume[77565]: DEBUG oslo_concurrency.lockutils [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Releasing lock "singleton_lock" {{(pid=77565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:58 devstack cinder-volume[77565]: WARNING amqp [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:15:58 devstack cinder-volume[77565]: WARNING amqp [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:15:58 devstack cinder-volume[77395]: INFO oslo_service.backend._eventlet.service [None req-67b11c19-ed6d-48fd-b439-d77455f505bb None None] Child 77565 exited with status 0 Jul 23 03:15:59 devstack cinder-volume[87641]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:15:59 devstack cinder-volume[87641]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:15:59 devstack cinder-volume[87641]: we strongly recommend against using it for new projects. Jul 23 03:15:59 devstack cinder-volume[87641]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:15:59 devstack cinder-volume[87641]: framework. For more detail see Jul 23 03:15:59 devstack cinder-volume[87641]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:15:59 devstack cinder-volume[87641]: import eventlet # noqa Jul 23 03:16:01 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:01 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:01 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:01 devstack cinder-volume[87641]: INFO dbcounter [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Registered counter for database cinder Jul 23 03:16:01 devstack cinder-volume[87641]: DEBUG oslo_db.sqlalchemy.engines [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG dbcounter [-] [87641] Writer thread running {{(pid=87641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:02 devstack cinder-volume[87641]: INFO cinder.rpc [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:16:02 devstack cinder-volume[87641]: INFO cinder.rpc [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_db.sqlalchemy.engines [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:02 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Determined volume DB was empty at startup. Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG cinder.volume.manager [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87641) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:16:02 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:16:02 devstack cinder-volume[87641]: WARNING stevedore.named [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:16:02 devstack cinder-volume[87641]: WARNING castellan.key_manager [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:02 devstack cinder-volume[87641]: WARNING cinder.keymgr.conf_key_mgr [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:02 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_db.sqlalchemy.engines [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:02 devstack cinder-volume[87641]: INFO oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Starting 1 workers Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Started child 87855 {{(pid=87641) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Full set of CONF: {{(pid=87641) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] ******************************************************************************** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Configuration options gathered from: {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] ================================================================================ {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] allow_availability_zone_fallback = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] allow_compression_on_image_upload = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] allowed_direct_url_schemes = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] api_rate_limit = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] auth_strategy = keystone {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_availability_zone = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_host = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87855]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_stats_polling_interval = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backup_api_class = cinder.backup.api.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backup_name_template = backup-%s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backup_use_same_host = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backup_use_temp_snapshot = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] chap_password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] chap_username = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_internal_tenant_project_id = ed5905293f2a40ac993e1168965afadc {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_internal_tenant_user_id = 485e1fbbd6174ee1bce4387cfe59c95d {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cluster = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] compression_format = gzip {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] compute_api_class = cinder.compute.nova.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] config_dir = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] config_source = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] control_exchange = openstack {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] debug = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] default_availability_zone = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] default_group_type = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] default_volume_type = QuobyteHD {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] disk_geometry = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_client_cert = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_client_cert_key = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_data_namespace = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_ssl_cert_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_ssl_cert_verify = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] driver_use_ssl = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] enable_new_services = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] enable_unsupported_driver = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] enabled_backends = ['QuobyteHD'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] enforce_multipath_for_image_xfer = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] filter_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_api_insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_api_ssl_compression = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_ca_certificates_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_catalog_info = image:glance:publicURL {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_num_retries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance_request_timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] goodness_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] graceful_shutdown_timeout = 5 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] group_api_class = cinder.group.api.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] host = devstack {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_compress_on_upload = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_conversion_address_space_limit = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_conversion_cpu_limit = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_conversion_disable = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_upload_use_cinder_backend = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_upload_use_internal_tenant = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_volume_cache_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_volume_cache_max_count = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] image_volume_cache_max_size_gb = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] init_host_max_objects_retrieval = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] instance_format = [instance: %(uuid)s] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iscsi_target_flags = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iscsi_write_cache = on {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iser_helper = tgtadm {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iser_ip_address = 192.168.122.7 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iser_port = 3260 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_color = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_config_append = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_dir = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_options = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_rotate_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_rotate_interval_type = days {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] log_rotation_type = none {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87855]: INFO cinder.volume.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:16:02 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.remotefs [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87855) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] max_age = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] max_logfile_count = 30 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] max_logfile_size_mb = 200 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] max_over_subscription_ratio = 20.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] message_reap_interval = 86400 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] message_ttl = 2592000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] migration_create_volume_timeout_secs = 300 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] monkey_patch = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] monkey_patch_modules = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] my_ip = 192.168.122.7 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] no_snapshot_gb_quota = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] num_iser_scan_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] num_shell_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] num_volume_device_scan_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] nvmeof_conn_info_version = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] nvmet_ns_id = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] nvmet_port_id = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_max_limit = 1000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_ext_list = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_listen = 0.0.0.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_listen_port = 8776 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_use_ssl = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] osapi_volume_workers = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] per_volume_size_limit = -1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] periodic_fuzzy_delay = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] periodic_interval = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] project_id_regex = [0-9a-f\-]+ {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] public_endpoint = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] publish_errors = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_backup_gigabytes = 1000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_backups = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_gigabytes = 1000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_groups = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_snapshots = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] quota_volumes = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] rate_limit_burst = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] rate_limit_except_level = CRITICAL {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] rate_limit_interval = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] reinit_driver_count = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] replication_device = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] report_discard_supported = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] report_interval = 120 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] reservation_clean_interval = 86400 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] reservation_expire = 86400 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] reserved_image_namespaces = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] reserved_percentage = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] rpc_response_timeout = 120 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] run_external_periodic_tasks = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] scst_target_driver = iscsi {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] scst_target_iqn_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_down_time = 720 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] shell_completion = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] snapshot_name_template = snapshot-%s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] split_loggers = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] state_path = /opt/stack/data/cinder {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] storage_availability_zone = nova {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] storage_protocol = iSCSI {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] syslog_log_facility = LOG_USER {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_helper = lioadm {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_ip_address = 192.168.122.7 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_port = 3260 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_protocol = iscsi {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] target_secondary_ip_addresses = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] trace_flags = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] transfer_api_class = cinder.transfer.api.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] transport_url = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] until_refresh = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_chap_auth = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_default_quota_class = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_journal = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_json = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_multipath_for_image_xfer = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_stderr = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] use_syslog = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] verify_glance_signatures = enabled {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_api_class = cinder.volume.api.API {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_backend_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_clear = zero {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_clear_ionice = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_clear_size = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_copy_bps_limit = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_dd_blocksize = 1M {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_name_template = volume-%s {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_service_inithost_offload = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volume_usage_audit_period = month {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] zoning_mode = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_concurrency.disable_process_locking = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.auth_section = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.auth_type = password {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.auth_version = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.cache = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.delay_auth_decision = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.http_connect_timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.include_service_catalog = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.interface = public {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_password = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcache_username = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.region_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.service_token_roles_required = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.service_type = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.token_cache_time = 300 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.backend = dogpile.cache.null {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.backend_argument = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.backend_expiration_time = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.config_prefix = cache.oslo {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.debug_cache_backend = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.enable_retry_client = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.enable_socket_keepalive = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.expiration_time = 600 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.hashclient_retry_attempts = 2 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_dead_retry = 300 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_pool_maxsize = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_sasl_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.proxies = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.redis_db = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.redis_sentinel_service_name = mymaster {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.redis_server = localhost:6379 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.retry_attempts = 2 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.retry_delay = 0.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.socket_keepalive_count = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.socket_keepalive_idle = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.socket_keepalive_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.socket_timeout = 1.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.tls_allowed_ciphers = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.tls_cafile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.tls_certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.tls_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.tls_keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cache.username = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] coordination.backend_url = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.asyncio_connection = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.asyncio_slave_connection = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.backend = sqlalchemy {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.connection = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.connection_debug = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.connection_parameters = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.connection_recycle_time = 3600 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.connection_trace = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.db_inc_retry_interval = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.db_max_retries = 20 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.db_max_retry_interval = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.db_retry_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.max_overflow = 50 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.max_pool_size = 5 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.max_retries = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.mysql_wsrep_sync_wait = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.pool_timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.retry_interval = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.slave_connection = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.sqlite_synchronous = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.synchronous_reader = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] database.use_db_reconnect = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.connection_string = messaging:// {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.es_doc_type = notification {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.es_scroll_size = 10000 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.es_scroll_time = 2m {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.filter_error_trace = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.hmac_keys = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.sentinel_service_name = mymaster {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.socket_timeout = 0.1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.trace_requests = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler.trace_sqlalchemy = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler_jaeger.process_tags = {} {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler_jaeger.service_name_prefix = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] profiler_otlp.service_name_prefix = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.enforce_new_defaults = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.policy_default_rule = default {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.policy_file = policy.yaml {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_policy.remote_timeout = 60.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.group = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.helper_command = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] privsep_osbrick.user = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.group = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.helper_command = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] cinder_sys_admin.user = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.auth_section = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.auth_type = password {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.cafile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.collect_timing = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.send_service_user_token = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.split_loggers = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] service_user.timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.auth_section = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.auth_type = password {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.collect_timing = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.region_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.split_loggers = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] glance.timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.backend_availability_zone = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.chap_password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.chap_username = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.disk_geometry = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_client_cert = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_client_cert_key = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_data_namespace = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.driver_use_ssl = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.enable_unsupported_driver = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.extra_capabilities = {} {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.filter_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.goodness_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iscsi_target_flags = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iscsi_write_cache = on {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iser_helper = tgtadm {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iser_port = 3260 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_host = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_login = admin {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_mount_options = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_private_key = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_share_path = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_ssh_port = 22 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.num_shell_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.nvmet_port_id = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_client_cfg = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.quobyte_volume_url = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.replication_device = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.report_discard_supported = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.reserved_percentage = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.scst_target_driver = iscsi {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.scst_target_iqn_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.storage_protocol = iSCSI {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_helper = tgtadm {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_port = 3260 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_protocol = iscsi {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.trace_flags = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.unique_fqdn_network = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.use_chap_auth = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_backend_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_clear = zero {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_clear_ionice = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_clear_size = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_reports.file_event_handler = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_reports.log_dir = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.backend_availability_zone = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.backend_host = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.chap_password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.chap_username = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.chiscsi_conf = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.disk_geometry = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_client_cert = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_client_cert_key = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_data_namespace = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.driver_use_ssl = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.extra_capabilities = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.filter_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.goodness_function = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iscsi_target_flags = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iscsi_write_cache = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iser_helper = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iser_ip_address = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iser_port = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.iser_target_prefix = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_host = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_login = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_mount_options = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_password = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_private_key = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87855) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:16:02 devstack cinder-volume[87855]: WARNING cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_share_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87855]: WARNING cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_ssh_port = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.num_shell_tries = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Running cmd (subprocess): mount.quobyte {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nvmet_ns_id = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.nvmet_port_id = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.replication_device = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.report_discard_supported = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.reserved_percentage = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.scst_target_driver = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.storage_protocol = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_helper = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_ip_address = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_port = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_prefix = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_protocol = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.trace_flags = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.unique_fqdn_network = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.use_chap_auth = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_clear = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_clear_ionice = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_clear_size = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] QuobyteHD.volumes_dir = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.ssl_version = {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_notifications.driver = [] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_notifications.retry = -1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] oslo_messaging_notifications.transport_url = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] key_manager.fixed_key = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.barbican_api_version = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.barbican_endpoint = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.barbican_endpoint_type = public {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.barbican_region_name = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.cafile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.collect_timing = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.number_of_retries = 60 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.retry_delay = 1 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.send_service_user_token = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.split_loggers = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.verify_ssl = True {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican.verify_ssl_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.auth_section = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.auth_type = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.cafile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.certfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.collect_timing = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.insecure = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.keyfile = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.split_loggers = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] barbican_service_user.timeout = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.approle_role_id = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.approle_secret_id = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.auth_method = approle {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.auth_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.kv_mountpoint = secret {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.kv_path = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.kv_version = 2 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.namespace = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.root_token_id = **** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.ssl_ca_crt_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.timeout = 60.0 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.token_file = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.token_role = None {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.use_ssl = False {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:02 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] ******************************************************************************** {{(pid=87641) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:16:03 devstack quobyte-client[87860]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:16:03 devstack quobyte-client[87860]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=87855) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:03 devstack cinder-volume[87855]: INFO cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 ... Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f -c /etc/quobyte/client-cinder.cfg {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:03 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f -c /etc/quobyte/client-cinder.cfg Jul 23 03:16:03 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:03 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.366s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:03 devstack cinder-volume[87855]: INFO cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 succeeded Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=87855) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.377s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:03 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:03 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:03 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.247s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:03 devstack cinder-volume[87855]: INFO cinder.volume.driver [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.volume.driver [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87855) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_db.sqlalchemy.engines [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG dbcounter [-] [87855] Writer thread running {{(pid=87855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.db.api [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Building query based on filter {{(pid=87855) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.image.image_utils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87855) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:03 devstack cinder-volume[87855]: INFO cinder.keymgr.migration [None req-ee0600bb-67c0-4a24-b9d9-21d02d724b78 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=87855) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=87855) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:03 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:03 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:03 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:04 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.218s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG cinder.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Notifying Schedulers of capabilities ... {{(pid=87855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:04 devstack cinder-volume[87855]: INFO cinder.volume.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Driver initialization completed successfully. Jul 23 03:16:04 devstack cinder-volume[87855]: INFO cinder.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Initiating service 3 cleanup Jul 23 03:16:04 devstack cinder-volume[87855]: INFO cinder.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Service 3 cleanup completed. Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG cinder.service [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Creating RPC server for service cinder-volume {{(pid=87855) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG cinder.service [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87855) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:04 devstack cinder-volume[87855]: INFO cinder.volume.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=87855) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=87855) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:04 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:04 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:04 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:04 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.251s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:04 devstack cinder-volume[87855]: INFO cinder.volume.manager [None req-b99906d0-65f4-4090-ba73-10817ba85fbd None None] Driver post RPC initialization completed successfully. Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=87855) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=87855) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87855) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:08 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:08 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:08 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:09 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:09 devstack cinder-volume[87855]: DEBUG oslo_concurrency.processutils [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.240s {{(pid=87855) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:09 devstack cinder-volume[87855]: DEBUG cinder.manager [None req-f0ccd149-36d3-4149-b415-5277ec1041d5 None None] Notifying Schedulers of capabilities ... {{(pid=87855) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:12 devstack cinder-volume[87641]: INFO oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Caught SIGTERM, stopping children Jul 23 03:16:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Acquiring lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Acquired lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Releasing lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:12 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Stop services. {{(pid=87641) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:16:12 devstack cinder-volume[87641]: DEBUG oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Killing children. {{(pid=87641) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:16:12 devstack cinder-volume[87641]: INFO oslo_service.backend._eventlet.service [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Waiting on 1 children to exit Jul 23 03:16:14 devstack cinder-volume[87855]: DEBUG dbcounter [-] [87855] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:14 devstack cinder-volume[87855]: DEBUG dbcounter [-] [87855] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87855) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:16 devstack cinder-volume[87855]: DEBUG oslo_service.periodic_task [None req-0cad2999-a702-4b10-888d-6e1764516cfc None None] Running periodic task VolumeManager._thread_info {{(pid=87855) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:16:16 devstack cinder-volume[87855]: DEBUG cinder.volume.manager [None req-0cad2999-a702-4b10-888d-6e1764516cfc None None] thread count: 6 {{(pid=87855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:16:16 devstack cinder-volume[87855]: DEBUG cinder.volume.manager [None req-0cad2999-a702-4b10-888d-6e1764516cfc None None] thread info: [<_MainThread(MainThread, started 130700378697856)>, , , , , ] {{(pid=87855) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:16:17 devstack cinder-volume[87855]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 23 03:16:17 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Acquiring lock "singleton_lock" {{(pid=87855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:17 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Acquired lock "singleton_lock" {{(pid=87855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:17 devstack cinder-volume[87855]: DEBUG oslo_concurrency.lockutils [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Releasing lock "singleton_lock" {{(pid=87855) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:17 devstack cinder-volume[87855]: WARNING amqp [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:17 devstack cinder-volume[87855]: WARNING amqp [None req-863a9ef3-4bc0-43a6-86e9-e6079c92aabf None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:17 devstack cinder-volume[88180]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:16:17 devstack cinder-volume[88180]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:16:17 devstack cinder-volume[88180]: we strongly recommend against using it for new projects. Jul 23 03:16:17 devstack cinder-volume[88180]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:16:17 devstack cinder-volume[88180]: framework. For more detail see Jul 23 03:16:17 devstack cinder-volume[88180]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:16:17 devstack cinder-volume[88180]: import eventlet # noqa Jul 23 03:16:20 devstack cinder-volume[88180]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:20 devstack cinder-volume[88180]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:20 devstack cinder-volume[88180]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88180) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:20 devstack cinder-volume[88180]: INFO dbcounter [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Registered counter for database cinder Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_db.sqlalchemy.engines [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG dbcounter [-] [88180] Writer thread running {{(pid=88180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:21 devstack cinder-volume[88180]: INFO cinder.rpc [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:16:21 devstack cinder-volume[88180]: INFO cinder.rpc [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_db.sqlalchemy.engines [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:21 devstack cinder-volume[88180]: INFO cinder.volume.manager [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Determined volume DB was empty at startup. Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG cinder.volume.manager [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88180) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:16:21 devstack cinder-volume[88180]: WARNING stevedore.named [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:16:21 devstack cinder-volume[88180]: WARNING castellan.key_manager [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:21 devstack cinder-volume[88180]: WARNING cinder.keymgr.conf_key_mgr [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:21 devstack cinder-volume[88180]: INFO cinder.volume.manager [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_db.sqlalchemy.engines [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88180) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:21 devstack cinder-volume[88180]: INFO oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Starting 1 workers Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Started child 88466 {{(pid=88180) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Full set of CONF: {{(pid=88180) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] ******************************************************************************** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] Configuration options gathered from: {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:16:21 devstack cinder-volume[88466]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] ================================================================================ {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] allow_availability_zone_fallback = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] allow_compression_on_image_upload = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] allowed_direct_url_schemes = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] api_rate_limit = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] auth_strategy = keystone {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_availability_zone = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_host = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_stats_polling_interval = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backup_api_class = cinder.backup.api.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backup_name_template = backup-%s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backup_use_same_host = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backup_use_temp_snapshot = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] chap_password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] chap_username = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_internal_tenant_project_id = ed5905293f2a40ac993e1168965afadc {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_internal_tenant_user_id = 485e1fbbd6174ee1bce4387cfe59c95d {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cluster = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] compression_format = gzip {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] compute_api_class = cinder.compute.nova.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] config_dir = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] config_source = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] control_exchange = openstack {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] debug = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] default_availability_zone = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] default_group_type = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] default_volume_type = QuobyteHD {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] disk_geometry = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_client_cert = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_client_cert_key = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_data_namespace = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_ssl_cert_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_ssl_cert_verify = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] driver_use_ssl = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] enable_new_services = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] enable_unsupported_driver = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] enabled_backends = ['QuobyteHD'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] enforce_multipath_for_image_xfer = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] filter_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_api_insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_api_ssl_compression = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_ca_certificates_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_catalog_info = image:glance:publicURL {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_num_retries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance_request_timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] goodness_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] graceful_shutdown_timeout = 5 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] group_api_class = cinder.group.api.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] host = devstack {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_compress_on_upload = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_conversion_address_space_limit = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_conversion_cpu_limit = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_conversion_disable = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_upload_use_cinder_backend = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_upload_use_internal_tenant = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_volume_cache_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_volume_cache_max_count = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] image_volume_cache_max_size_gb = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] init_host_max_objects_retrieval = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] instance_format = [instance: %(uuid)s] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iscsi_target_flags = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iscsi_write_cache = on {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iser_helper = tgtadm {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88466) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iser_ip_address = 192.168.122.7 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iser_port = 3260 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_color = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_config_append = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_dir = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_options = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_rotate_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_rotate_interval_type = days {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] log_rotation_type = none {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] max_age = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] max_logfile_count = 30 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] max_logfile_size_mb = 200 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] max_over_subscription_ratio = 20.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] message_reap_interval = 86400 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] message_ttl = 2592000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] migration_create_volume_timeout_secs = 300 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] monkey_patch = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] monkey_patch_modules = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] my_ip = 192.168.122.7 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] no_snapshot_gb_quota = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] num_iser_scan_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] num_shell_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] num_volume_device_scan_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] nvmeof_conn_info_version = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] nvmet_ns_id = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] nvmet_port_id = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_max_limit = 1000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_ext_list = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_listen_port = 8776 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_use_ssl = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] osapi_volume_workers = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] per_volume_size_limit = -1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] periodic_fuzzy_delay = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] periodic_interval = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] public_endpoint = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] publish_errors = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_backup_gigabytes = 1000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_backups = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_gigabytes = 1000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_groups = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_snapshots = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] quota_volumes = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] rate_limit_burst = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] rate_limit_except_level = CRITICAL {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] rate_limit_interval = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] reinit_driver_count = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] replication_device = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] report_discard_supported = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] report_interval = 120 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] reservation_clean_interval = 86400 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] reservation_expire = 86400 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] reserved_image_namespaces = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] reserved_percentage = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] rpc_response_timeout = 120 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] run_external_periodic_tasks = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] scst_target_driver = iscsi {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] scst_target_iqn_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_down_time = 720 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] shell_completion = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] snapshot_name_template = snapshot-%s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] split_loggers = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] state_path = /opt/stack/data/cinder {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] storage_availability_zone = nova {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] storage_protocol = iSCSI {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] syslog_log_facility = LOG_USER {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_helper = lioadm {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_ip_address = 192.168.122.7 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_port = 3260 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_protocol = iscsi {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] target_secondary_ip_addresses = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] trace_flags = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] transport_url = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] until_refresh = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_chap_auth = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_default_quota_class = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_journal = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_json = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_multipath_for_image_xfer = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_stderr = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] use_syslog = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] verify_glance_signatures = enabled {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_api_class = cinder.volume.api.API {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_backend_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_clear = zero {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_clear_ionice = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_clear_size = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_copy_bps_limit = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_dd_blocksize = 1M {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_name_template = volume-%s {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_service_inithost_offload = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volume_usage_audit_period = month {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] zoning_mode = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_concurrency.disable_process_locking = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.auth_section = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.auth_type = password {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.auth_version = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.cache = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.include_service_catalog = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.interface = public {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_password = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcache_username = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.region_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.service_type = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.backend = dogpile.cache.null {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.backend_argument = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88466) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:16:21 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.backend_expiration_time = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.config_prefix = cache.oslo {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.debug_cache_backend = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.enable_retry_client = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.enable_socket_keepalive = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.expiration_time = 600 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.hashclient_retry_attempts = 2 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Running cmd (subprocess): mount.quobyte {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_dead_retry = 300 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_pool_maxsize = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_sasl_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.proxies = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.redis_db = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.redis_server = localhost:6379 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.retry_attempts = 2 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.retry_delay = 0.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.socket_keepalive_count = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.socket_keepalive_idle = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.socket_keepalive_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.socket_timeout = 1.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.tls_allowed_ciphers = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.tls_cafile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.tls_certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.tls_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.tls_keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cache.username = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] coordination.backend_url = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.asyncio_connection = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.asyncio_slave_connection = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.backend = sqlalchemy {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.connection = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.connection_debug = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.connection_parameters = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.connection_recycle_time = 3600 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.connection_trace = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.db_inc_retry_interval = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.db_max_retries = 20 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.db_max_retry_interval = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.db_retry_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.max_overflow = 50 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.max_pool_size = 5 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.max_retries = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.mysql_wsrep_sync_wait = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.pool_timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.retry_interval = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.slave_connection = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.sqlite_synchronous = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.synchronous_reader = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] database.use_db_reconnect = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.connection_string = messaging:// {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.es_doc_type = notification {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.es_scroll_size = 10000 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.es_scroll_time = 2m {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.filter_error_trace = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.hmac_keys = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.sentinel_service_name = mymaster {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.socket_timeout = 0.1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.trace_requests = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler.trace_sqlalchemy = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler_jaeger.process_tags = {} {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler_jaeger.service_name_prefix = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] profiler_otlp.service_name_prefix = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.enforce_new_defaults = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.policy_default_rule = default {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.policy_file = policy.yaml {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.group = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.helper_command = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] privsep_osbrick.user = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.group = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.helper_command = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] cinder_sys_admin.user = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.auth_section = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.auth_type = password {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.cafile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.collect_timing = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.send_service_user_token = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.split_loggers = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] service_user.timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.auth_section = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.auth_type = password {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.collect_timing = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.region_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.split_loggers = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] glance.timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.backend_availability_zone = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.chap_password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.chap_username = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.disk_geometry = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_client_cert = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_client_cert_key = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_data_namespace = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.driver_use_ssl = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.extra_capabilities = {} {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.filter_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.goodness_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iscsi_target_flags = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iscsi_write_cache = on {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iser_helper = tgtadm {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iser_port = 3260 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_host = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_login = admin {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_mount_options = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_private_key = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_share_path = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.num_shell_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.quobyte_volume_url = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.replication_device = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.report_discard_supported = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.reserved_percentage = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack quobyte-client[88468]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_helper = tgtadm {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack quobyte-client[88468]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_port = 3260 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_protocol = iscsi {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.trace_flags = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.unique_fqdn_network = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.use_chap_auth = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_backend_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_clear = zero {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_clear_ionice = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_clear_size = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_reports.file_event_handler = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_reports.log_dir = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.backend_availability_zone = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.backend_host = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.chap_password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.chap_username = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.chiscsi_conf = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.disk_geometry = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_client_cert = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_data_namespace = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.driver_use_ssl = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.extra_capabilities = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.filter_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.goodness_function = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iser_helper = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iser_ip_address = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iser_port = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.iser_target_prefix = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_host = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_login = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_mount_options = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_password = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_private_key = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_share_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_ssh_port = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.num_shell_tries = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.nvmet_port_id = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.replication_device = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.report_discard_supported = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.reserved_percentage = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.scst_target_driver = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.storage_protocol = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_helper = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_ip_address = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_port = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_prefix = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_protocol = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.trace_flags = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.use_chap_auth = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_clear = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_clear_size = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] QuobyteHD.volumes_dir = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_notifications.driver = [] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_notifications.retry = -1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] key_manager.fixed_key = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.barbican_api_version = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.barbican_endpoint = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.barbican_endpoint_type = public {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.barbican_region_name = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.cafile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.collect_timing = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.number_of_retries = 60 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.retry_delay = 1 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.send_service_user_token = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.split_loggers = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.verify_ssl = True {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican.verify_ssl_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.auth_section = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.auth_type = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.cafile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.certfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.collect_timing = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.insecure = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.keyfile = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.split_loggers = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] barbican_service_user.timeout = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.approle_role_id = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.approle_secret_id = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.auth_method = approle {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.auth_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.kv_mountpoint = secret {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.kv_path = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.kv_version = 2 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.namespace = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.root_token_id = **** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.ssl_ca_crt_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.timeout = 60.0 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.token_file = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.token_role = None {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.use_ssl = False {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:21 devstack cinder-volume[88180]: DEBUG oslo_service.backend._eventlet.service [None req-8854af14-d28b-4492-86c7-1638d94df092 None None] ******************************************************************************** {{(pid=88180) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:16:22 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.volume.driver [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.volume.driver [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88466) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writer thread running {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.db.api [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Building query based on filter {{(pid=88466) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88466) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.keymgr.migration [None req-ffd4595f-cacd-409a-847e-33c1c6c06598 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:22 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:22 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:22 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.230s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Driver initialization completed successfully. Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Initiating service 3 cleanup Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Service 3 cleanup completed. Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.service [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Creating RPC server for service cinder-volume {{(pid=88466) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.service [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88466) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:22 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:16:22 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:22 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4dbba97f-03c7-400e-ac45-881d27725b62 None None] Driver post RPC initialization completed successfully. Jul 23 03:16:31 devstack cinder-volume[88180]: DEBUG dbcounter [-] [88180] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88180) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:16:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 6 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:16:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:17:35 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Flow 'volume_create_manager' (80cef45f-d38c-4e92-88e6-f175f2c375d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b18723b-66c5-4891-82c9-a3ecda4d22cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b18723b-66c5-4891-82c9-a3ecda4d22cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2138890780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a8331-9253-4f35-9554-566c62ee3353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585ea6f33ae948ce966e95bf130a61e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:36Z,use_quota=True,user_id='f54ee790b85340949c8c8883fcc35612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0eb00c-0589-4c86-8b62-46df6a9a3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0eb00c-0589-4c86-8b62-46df6a9a3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190b652-f665-46c6-9c9d-e18da743de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2190b652-f665-46c6-9c9d-e18da743de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372a8331-9253-4f35-9554-566c62ee3353', 'volume_name': 'volume-372a8331-9253-4f35-9554-566c62ee3353', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa82929-21f5-46cc-8391-766cade65a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa82929-21f5-46cc-8391-766cade65a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d7495a-fbcb-4037-aa1e-92d1d1408110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Volume 372a8331-9253-4f35-9554-566c62ee3353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372a8331-9253-4f35-9554-566c62ee3353', 'volume_size': 1} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2138890780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a8331-9253-4f35-9554-566c62ee3353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585ea6f33ae948ce966e95bf130a61e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:36Z,use_quota=True,user_id='f54ee790b85340949c8c8883fcc35612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Creating volume 372a8331-9253-4f35-9554-566c62ee3353 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:17:36 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:17:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:36 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 1073741824 Jul 23 03:17:36 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:37 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 1073741824" returned: 0 in 1.524s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:38 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 Jul 23 03:17:38 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:38 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353" returned: 0 in 0.702s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.535s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d7495a-fbcb-4037-aa1e-92d1d1408110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372a8331-9253-4f35-9554-566c62ee3353', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0859d-d459-440b-bcfc-f9389009a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:39 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Volume volume-372a8331-9253-4f35-9554-566c62ee3353 (372a8331-9253-4f35-9554-566c62ee3353): created successfully Jul 23 03:17:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0859d-d459-440b-bcfc-f9389009a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Flow 'volume_create_manager' (80cef45f-d38c-4e92-88e6-f175f2c375d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b422c58d-ca42-49c2-b3f7-c893bd5ca4cd tempest-DeleteServersTestJSON-2088698375 None] Created volume successfully. Jul 23 03:17:43 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:17:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Flow 'volume_create_manager' (05af2c52-7791-4b44-81f3-d267e11e83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2f45b7-41b2-4afb-9454-086232fc578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2f45b7-41b2-4afb-9454-086232fc578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1445592982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ed9e77-9eb5-4a55-a630-100325c18676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4dcf1436ed4327aeb5ed756513430c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:44Z,use_quota=True,user_id='ac49afc0b66e459dbf59c3668cdfd51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fec769-fc4e-4c47-acff-c4a639b8f3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fec769-fc4e-4c47-acff-c4a639b8f3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ba4c2-a45f-49e2-8917-988e5431ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ba4c2-a45f-49e2-8917-988e5431ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ed9e77-9eb5-4a55-a630-100325c18676', 'volume_name': 'volume-45ed9e77-9eb5-4a55-a630-100325c18676', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952a434-f2d2-4eb2-a33c-17593d4042ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952a434-f2d2-4eb2-a33c-17593d4042ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f817b-cdfa-488a-889c-17304f6f1d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:44 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Volume 45ed9e77-9eb5-4a55-a630-100325c18676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ed9e77-9eb5-4a55-a630-100325c18676', 'volume_size': 1} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1445592982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ed9e77-9eb5-4a55-a630-100325c18676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4dcf1436ed4327aeb5ed756513430c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:44Z,use_quota=True,user_id='ac49afc0b66e459dbf59c3668cdfd51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Creating volume 45ed9e77-9eb5-4a55-a630-100325c18676 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:17:44 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:17:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:44 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 1073741824 Jul 23 03:17:44 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:45 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 1073741824" returned: 0 in 1.163s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:45 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 Jul 23 03:17:45 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:45 devstack cinder-volume[88466]: WARNING py.warnings [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 23 03:17:45 devstack cinder-volume[88466]: .first() Jul 23 03:17:45 devstack cinder-volume[88466]: Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:45 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676" returned: 0 in 0.586s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.183s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f817b-cdfa-488a-889c-17304f6f1d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ed9e77-9eb5-4a55-a630-100325c18676', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929f7f6c-b0fa-40b4-a2be-9ebe541942b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.186s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Volume volume-45ed9e77-9eb5-4a55-a630-100325c18676 (45ed9e77-9eb5-4a55-a630-100325c18676): created successfully Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929f7f6c-b0fa-40b4-a2be-9ebe541942b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Flow 'volume_create_manager' (05af2c52-7791-4b44-81f3-d267e11e83ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1055e496-4790-4b69-b27f-0d263c17838a tempest-ServerRescueNegativeTestJSON-1361155346 None] Created volume successfully. Jul 23 03:17:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-372a8331-9253-4f35-9554-566c62ee3353', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78944d54-7080-45c1-b834-850e84d562a0', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:17:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-9fcbd539-e053-4415-ad1f-e3c01b8dff02 req-806e71dd-f26f-45d5-b8c3-83aa3eb159e1 tempest-DeleteServersTestJSON-2088698375 None] attachment_update completed successfully. Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:47 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:17:47 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:48 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.700s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:17:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:17:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 6 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:17:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:17:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-2abd378c-ce6b-40d5-8c71-b9857a9c0d56 req-5e014791-e345-4418-9c0d-7fc0d7700dad tempest-DeleteServersTestJSON-2088698375 None] Terminate volume connection completed successfully. Jul 23 03:17:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-2abd378c-ce6b-40d5-8c71-b9857a9c0d56 req-5e014791-e345-4418-9c0d-7fc0d7700dad tempest-DeleteServersTestJSON-2088698375 None] Deleting attachment 78944d54-7080-45c1-b834-850e84d562a0. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:17:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "cinder-372a8331-9253-4f35-9554-566c62ee3353-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "cinder-372a8331-9253-4f35-9554-566c62ee3353-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "cinder-quobyte-372a8331-9253-4f35-9554-566c62ee3353" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "cinder-quobyte-372a8331-9253-4f35-9554-566c62ee3353" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:56 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3pwwupz5/privsep.sock'] Jul 23 03:17:56 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3pwwupz5/privsep.sock Jul 23 03:17:56 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:17:58 devstack cinder-volume[88466]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 23 03:17:58 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:58 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Spawned new privsep daemon via rootwrap Jul 23 03:17:58 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Accepted privsep connection to /tmp/tmp3pwwupz5/privsep.sock {{(pid=88466) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 23 03:17:58 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 23 03:17:58 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 23 03:17:58 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 23 03:17:58 devstack cinder-volume[88466]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90379 Jul 23 03:17:58 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5563e1-a247-4d5b-ba07-634cff5206bf]: (2,) {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:17:58 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57ad52-1747-42e6-81e8-0bbfcbf56317]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:17:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:58 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 Jul 23 03:17:58 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:59 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353" returned: 0 in 0.723s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:59 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353 Jul 23 03:17:59 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:59 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-372a8331-9253-4f35-9554-566c62ee3353" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "cinder-quobyte-372a8331-9253-4f35-9554-566c62ee3353" released by "delete_volume" :: held 3.541s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:17:59 devstack cinder-volume[88466]: WARNING cinder.quota [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:17:59 devstack cinder-volume[88466]: WARNING cinder.quota [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Created reservations ['1a26578d-10f5-42dd-9155-de7ade12cfcc', '6cf2f24f-47d9-45a7-9e3e-5a7dcb1efeed', '66bc7774-c406-4378-9dd6-65a0d9382ab0', '93413cd5-cd25-40b5-84e2-94cfee691395'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:00 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:18:00 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:00 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.485s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:00 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Deleted volume successfully. Jul 23 03:18:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b72e568-18e3-476f-a2e3-c767098c5c61 tempest-DeleteServersTestJSON-2088698375 None] Lock "cinder-372a8331-9253-4f35-9554-566c62ee3353-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Acquiring lock "cinder-45ed9e77-9eb5-4a55-a630-100325c18676-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "cinder-45ed9e77-9eb5-4a55-a630-100325c18676-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Acquiring lock "cinder-quobyte-45ed9e77-9eb5-4a55-a630-100325c18676" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "cinder-quobyte-45ed9e77-9eb5-4a55-a630-100325c18676" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c93a94-0297-4a0a-9b99-50dd29943a51]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:18:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:03 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 Jul 23 03:18:03 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:03 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676" returned: 0 in 0.592s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:03 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676 Jul 23 03:18:03 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:03 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-45ed9e77-9eb5-4a55-a630-100325c18676" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "cinder-quobyte-45ed9e77-9eb5-4a55-a630-100325c18676" released by "delete_volume" :: held 1.092s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Created reservations ['eef9b25c-e10b-4a09-ba39-62a1b830d8fb', '9b527a24-9c75-4541-b781-f5e8c7054db2', '56dbfd8a-ea07-4693-afd4-40d83fdd6466', '9099c73f-1332-4b34-97a6-553d88c86300'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:04 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:18:04 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:04 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.333s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Deleted volume successfully. Jul 23 03:18:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a292b5ff-fd6f-4b3a-a815-3ab7f9390c51 tempest-ServerRescueNegativeTestJSON-1361155346 None] Lock "cinder-45ed9e77-9eb5-4a55-a630-100325c18676-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Flow 'volume_create_manager' (8df06c1a-0710-41a9-b8ab-e1ef63076fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b58189-ce41-4fac-9817-697c0ba259f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b58189-ce41-4fac-9817-697c0ba259f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622876634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6d51e2-89a7-42bd-afb1-6a4753c69d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8601f23d146678067c95bcc8064cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:10Z,use_quota=True,user_id='f98d264110a84ff4b6a0915c311b5ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d977d98-9390-4259-be8d-59554659cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d977d98-9390-4259-be8d-59554659cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd97c9e-3834-4c85-9712-0cb8b597a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd97c9e-3834-4c85-9712-0cb8b597a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'volume_name': 'volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba754bc-8ba7-44d3-b914-68ae3b223534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba754bc-8ba7-44d3-b914-68ae3b223534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf5634-1de5-4536-85fa-d60c1cf8185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Volume 9d6d51e2-89a7-42bd-afb1-6a4753c69d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'volume_size': 1} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622876634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6d51e2-89a7-42bd-afb1-6a4753c69d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8601f23d146678067c95bcc8064cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:10Z,use_quota=True,user_id='f98d264110a84ff4b6a0915c311b5ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Creating volume 9d6d51e2-89a7-42bd-afb1-6a4753c69d90 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:18:10 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:18:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:10 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 1073741824 Jul 23 03:18:10 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:11 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 1073741824" returned: 0 in 0.700s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:11 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 Jul 23 03:18:11 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:11 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" returned: 0 in 0.287s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf5634-1de5-4536-85fa-d60c1cf8185f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ceceae7-e8fa-4173-9936-b88f0fddafd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Volume volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 (9d6d51e2-89a7-42bd-afb1-6a4753c69d90): created successfully Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ceceae7-e8fa-4173-9936-b88f0fddafd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Flow 'volume_create_manager' (8df06c1a-0710-41a9-b8ab-e1ef63076fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7f384bf5-e7d1-4f78-87b1-cfd2aedd80c6 tempest-ServerActionsTestOtherA-421707419 None] Created volume successfully. Jul 23 03:18:21 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=31,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:21 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=4 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Flow 'volume_create_manager' (757d1c4f-3bf6-4b09-aaa8-9bba5bc8bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8e71cf-3cf8-4b18-8a6f-78b7d82a755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8e71cf-3cf8-4b18-8a6f-78b7d82a755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-898045392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b639a-cb21-4c39-b627-aa7522c1d22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c62b539cc247978eb605d3447b3073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:48Z,use_quota=True,user_id='27b5e98e70d64bcbb542ff9595e09659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314d2cd5-2cc4-4630-aa92-6b8edd72ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314d2cd5-2cc4-4630-aa92-6b8edd72ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99625aed-9af5-47c8-ba9e-9734cf22766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99625aed-9af5-47c8-ba9e-9734cf22766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50b639a-cb21-4c39-b627-aa7522c1d22d', 'volume_name': 'volume-a50b639a-cb21-4c39-b627-aa7522c1d22d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84738d90-4186-4562-aca0-8ae36607af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84738d90-4186-4562-aca0-8ae36607af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bc206d-f173-4b71-8169-a0fe4d5871d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Volume a50b639a-cb21-4c39-b627-aa7522c1d22d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50b639a-cb21-4c39-b627-aa7522c1d22d', 'volume_size': 1} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-898045392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b639a-cb21-4c39-b627-aa7522c1d22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c62b539cc247978eb605d3447b3073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:48Z,use_quota=True,user_id='27b5e98e70d64bcbb542ff9595e09659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Creating volume a50b639a-cb21-4c39-b627-aa7522c1d22d {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:18:47 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:47 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d 1073741824 Jul 23 03:18:47 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:47 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:18:47 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:48 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.337s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:48 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d 1073741824" returned: 0 in 0.588s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:48 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d Jul 23 03:18:48 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:48 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bc206d-f173-4b71-8169-a0fe4d5871d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50b639a-cb21-4c39-b627-aa7522c1d22d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a029be-87e7-4e8f-9895-6d20f2b30eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:48 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Volume volume-a50b639a-cb21-4c39-b627-aa7522c1d22d (a50b639a-cb21-4c39-b627-aa7522c1d22d): created successfully Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a029be-87e7-4e8f-9895-6d20f2b30eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Flow 'volume_create_manager' (757d1c4f-3bf6-4b09-aaa8-9bba5bc8bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-545b415c-45a9-4a5d-a860-dc197007f5fb tempest-TaggedAttachmentsTest-2138282335 None] Created volume successfully. Jul 23 03:18:58 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:58 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:08 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Flow 'volume_create_manager' (e6290328-453a-4e6c-82ac-db0c0f874fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b741a3-0b06-4e4f-a63a-a480f79545e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b741a3-0b06-4e4f-a63a-a480f79545e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1413245568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09bda5-cc67-4023-8c76-76cdde228760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0ce441f5604db286f149a4f969dfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:09Z,use_quota=True,user_id='82f48e78ba194a6597c2d80c27722f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f17628-942c-46d0-893a-b6fb2a3cad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f17628-942c-46d0-893a-b6fb2a3cad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd4960c-a688-4928-b967-5daaf4693540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd4960c-a688-4928-b967-5daaf4693540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b09bda5-cc67-4023-8c76-76cdde228760', 'volume_name': 'volume-6b09bda5-cc67-4023-8c76-76cdde228760', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a9512-3a12-4ca8-aa77-e7e26cad877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8a9512-3a12-4ca8-aa77-e7e26cad877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b18649-d636-4781-b798-73c9c3f3bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Volume 6b09bda5-cc67-4023-8c76-76cdde228760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b09bda5-cc67-4023-8c76-76cdde228760', 'volume_size': 1} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1413245568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09bda5-cc67-4023-8c76-76cdde228760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0ce441f5604db286f149a4f969dfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:09Z,use_quota=True,user_id='82f48e78ba194a6597c2d80c27722f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Creating volume 6b09bda5-cc67-4023-8c76-76cdde228760 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:09 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:19:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:09 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 1073741824 Jul 23 03:19:09 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:10 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 1073741824" returned: 0 in 0.924s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:10 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 Jul 23 03:19:10 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:11 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760" returned: 0 in 0.853s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b18649-d636-4781-b798-73c9c3f3bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b09bda5-cc67-4023-8c76-76cdde228760', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c95d4e6-7e32-443a-b332-758fb2be078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Volume volume-6b09bda5-cc67-4023-8c76-76cdde228760 (6b09bda5-cc67-4023-8c76-76cdde228760): created successfully Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c95d4e6-7e32-443a-b332-758fb2be078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Flow 'volume_create_manager' (e6290328-453a-4e6c-82ac-db0c0f874fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d7fca108-4ac9-40d5-9b01-cd7d76c76a61 tempest-VolumesAdminNegativeTest-819146206 None] Created volume successfully. Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Acquiring lock "cinder-6b09bda5-cc67-4023-8c76-76cdde228760-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "cinder-6b09bda5-cc67-4023-8c76-76cdde228760-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Acquiring lock "cinder-quobyte-6b09bda5-cc67-4023-8c76-76cdde228760" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "cinder-quobyte-6b09bda5-cc67-4023-8c76-76cdde228760" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[de203393-2616-438b-a0fc-6555ae659dc6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:13 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 Jul 23 03:19:13 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:14 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760" returned: 0 in 0.627s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:14 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760 Jul 23 03:19:14 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:15 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b09bda5-cc67-4023-8c76-76cdde228760" returned: 0 in 0.678s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "cinder-quobyte-6b09bda5-cc67-4023-8c76-76cdde228760" released by "delete_volume" :: held 1.436s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Created reservations ['0ca8a3c5-e043-4f5a-a149-df1069e334bb', '9a950510-2a88-4383-840c-7886fb74c316', '2db50d1c-664b-49d3-86d9-045021a90a25', 'd0f438ba-e1e4-4103-8b1d-664b98d54a6c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:15 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:19:15 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:16 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.608s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Deleted volume successfully. Jul 23 03:19:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eb2cbe1e-a9f9-404c-b7f9-fb7c9283d93f tempest-VolumesAdminNegativeTest-819146206 None] Lock "cinder-6b09bda5-cc67-4023-8c76-76cdde228760-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:25 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-f570da5f-6b46-4191-9784-4c38b1c0aff0 req-f91d2289-8bc6-47ee-ae00-cab211d0114f tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-f570da5f-6b46-4191-9784-4c38b1c0aff0 req-f91d2289-8bc6-47ee-ae00-cab211d0114f tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-f570da5f-6b46-4191-9784-4c38b1c0aff0 req-f91d2289-8bc6-47ee-ae00-cab211d0114f tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:25 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-f570da5f-6b46-4191-9784-4c38b1c0aff0 req-f91d2289-8bc6-47ee-ae00-cab211d0114f tempest-ServerActionsTestOtherA-421707419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c1e90be-9d8e-4432-ad3b-feb779574f39', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-f570da5f-6b46-4191-9784-4c38b1c0aff0 req-f91d2289-8bc6-47ee-ae00-cab211d0114f tempest-ServerActionsTestOtherA-421707419 None] attachment_update completed successfully. Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Flow 'volume_create_manager' (6eb323ab-8c71-4b32-b475-e739d9fc5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b7cd1c-34d1-47d0-8d15-6be0f46f11e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b7cd1c-34d1-47d0-8d15-6be0f46f11e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406439441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50ec19f-bbe9-4e0c-9800-41b55f61c4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc62c9887bc48999135f4a818c72e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:31Z,use_quota=True,user_id='616cb33d0b9343a8acccab2c754a4167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e747d4d-7c7b-4b7f-9f97-e931763ef834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e747d4d-7c7b-4b7f-9f97-e931763ef834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966e52d9-f3c7-4c53-bf24-a31957aa9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966e52d9-f3c7-4c53-bf24-a31957aa9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50ec19f-bbe9-4e0c-9800-41b55f61c4e5', 'volume_name': 'volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378f2799-a6fe-4fdc-be61-4da45d593c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378f2799-a6fe-4fdc-be61-4da45d593c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edb478e-4923-4069-9dd6-7f8cb141dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:31 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Volume e50ec19f-bbe9-4e0c-9800-41b55f61c4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5', 'volume_size': 1} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406439441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50ec19f-bbe9-4e0c-9800-41b55f61c4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc62c9887bc48999135f4a818c72e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:31Z,use_quota=True,user_id='616cb33d0b9343a8acccab2c754a4167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Creating volume e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:31 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:31 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 1073741824 Jul 23 03:19:31 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-b8431232-0320-4b31-a85e-d2fa33478350 tempest-ServerActionsTestOtherA-421707419 None] Terminate volume connection completed successfully. Jul 23 03:19:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-b8431232-0320-4b31-a85e-d2fa33478350 tempest-ServerActionsTestOtherA-421707419 None] Deleting attachment 5c1e90be-9d8e-4432-ad3b-feb779574f39. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:19:32 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 1073741824" returned: 0 in 0.657s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:32 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 Jul 23 03:19:32 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:32 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" returned: 0 in 0.655s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edb478e-4923-4069-9dd6-7f8cb141dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c8b248-9275-40ab-8e80-aa21298fc90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:32 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Volume volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 (e50ec19f-bbe9-4e0c-9800-41b55f61c4e5): created successfully Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c8b248-9275-40ab-8e80-aa21298fc90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Flow 'volume_create_manager' (6eb323ab-8c71-4b32-b475-e739d9fc5315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:32 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-25bf74e8-b243-4585-84d7-285e9335fb2e tempest-ServersNegativeTestJSON-1026726405 None] Created volume successfully. Jul 23 03:19:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-652ed3a6-35cf-419b-aba0-5942465c9c1b tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-652ed3a6-35cf-419b-aba0-5942465c9c1b tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-652ed3a6-35cf-419b-aba0-5942465c9c1b tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-652ed3a6-35cf-419b-aba0-5942465c9c1b tempest-ServerActionsTestOtherA-421707419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b8c1e13-1fa0-4250-987e-0d5f733bd92d', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-6cfc5d65-4141-4a88-9245-e6f294478e5b req-652ed3a6-35cf-419b-aba0-5942465c9c1b tempest-ServerActionsTestOtherA-421707419 None] attachment_update completed successfully. Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Flow 'volume_create_manager' (c069ea94-9012-46f3-ace6-e173ad4007b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fd735b-df82-4e3c-ba97-6e58d62cb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fd735b-df82-4e3c-ba97-6e58d62cb30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-898244030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65a74b3-ad82-48c3-8bd3-94e429125da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc62c9887bc48999135f4a818c72e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:36Z,use_quota=True,user_id='616cb33d0b9343a8acccab2c754a4167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9851e31a-5e2c-47c2-b279-aa28d7d0b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9851e31a-5e2c-47c2-b279-aa28d7d0b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239bced2-d280-44bb-b036-a8305e5763ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239bced2-d280-44bb-b036-a8305e5763ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65a74b3-ad82-48c3-8bd3-94e429125da7', 'volume_name': 'volume-d65a74b3-ad82-48c3-8bd3-94e429125da7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92328909-021c-4b70-ace6-3919eabc7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92328909-021c-4b70-ace6-3919eabc7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7474443-9e31-4a5d-a145-b79cb4956b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:35 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Volume d65a74b3-ad82-48c3-8bd3-94e429125da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65a74b3-ad82-48c3-8bd3-94e429125da7', 'volume_size': 1} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-898244030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65a74b3-ad82-48c3-8bd3-94e429125da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc62c9887bc48999135f4a818c72e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:36Z,use_quota=True,user_id='616cb33d0b9343a8acccab2c754a4167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Creating volume d65a74b3-ad82-48c3-8bd3-94e429125da7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:35 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:19:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:35 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 1073741824 Jul 23 03:19:35 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:36 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 1073741824" returned: 0 in 0.600s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:36 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 Jul 23 03:19:36 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:36 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7474443-9e31-4a5d-a145-b79cb4956b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65a74b3-ad82-48c3-8bd3-94e429125da7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc86bca-12d8-4db4-bf91-e72967bcf424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Volume volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 (d65a74b3-ad82-48c3-8bd3-94e429125da7): created successfully Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc86bca-12d8-4db4-bf91-e72967bcf424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Flow 'volume_create_manager' (c069ea94-9012-46f3-ace6-e173ad4007b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3cc7fed6-109c-4dc3-aeac-0cf6ed882637 tempest-ServersNegativeTestJSON-1026726405 None] Created volume successfully. Jul 23 03:19:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "cinder-d65a74b3-ad82-48c3-8bd3-94e429125da7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-d65a74b3-ad82-48c3-8bd3-94e429125da7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "cinder-quobyte-d65a74b3-ad82-48c3-8bd3-94e429125da7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-quobyte-d65a74b3-ad82-48c3-8bd3-94e429125da7" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e5ced6-ec92-4639-8fdf-f900a7fa4f98]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:38 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 Jul 23 03:19:38 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:38 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7" returned: 0 in 0.548s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:38 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7 Jul 23 03:19:38 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:38 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d65a74b3-ad82-48c3-8bd3-94e429125da7" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-quobyte-d65a74b3-ad82-48c3-8bd3-94e429125da7" released by "delete_volume" :: held 0.886s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Created reservations ['fb7a5539-a5ad-4097-9322-89bf2396eb93', '210e5534-5000-48dc-88c5-5147411e781f', 'ac7f835a-b1f7-4496-8130-84363cd84032', 'd9f6bc24-d7ba-4cf6-972c-d9227a979c36'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:39 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:19:39 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "cinder-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "cinder-quobyte-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-quobyte-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" acquired by "delete_volume" :: waited 0.077s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ceca92-9389-45c0-8c57-57e0572a2fce]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:39 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.527s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Deleted volume successfully. Jul 23 03:19:39 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 Jul 23 03:19:39 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6c6afeab-c679-425e-af98-1d725ac8a412 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-d65a74b3-ad82-48c3-8bd3-94e429125da7-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:40 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" returned: 0 in 0.720s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:40 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5 Jul 23 03:19:40 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:40 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" returned: 0 in 0.401s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-quobyte-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5" released by "delete_volume" :: held 1.224s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Created reservations ['6d97349a-99a8-45fc-b617-6b552aaf2141', '57965c45-7eee-4f9b-9e0e-a6586bbbd1b6', '2b8171aa-987e-47b3-8bed-4c10cc3be261', '39f2f6cf-0256-4704-934d-492e340fa76a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:40 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:19:40 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:41 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.296s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:41 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Deleted volume successfully. Jul 23 03:19:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60f77681-6308-4f2e-8f5c-9bc9bd12f967 tempest-ServersNegativeTestJSON-1026726405 None] Lock "cinder-e50ec19f-bbe9-4e0c-9800-41b55f61c4e5-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:47 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:19:47 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:48 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.533s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 8 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:19:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:19:50 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:51 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=34,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=4 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-3d5ef144-d993-4538-9ee4-4883603d4bc4 req-a87ed38a-634f-4ed5-a019-660d4bc4248c tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-3d5ef144-d993-4538-9ee4-4883603d4bc4 req-a87ed38a-634f-4ed5-a019-660d4bc4248c tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-3d5ef144-d993-4538-9ee4-4883603d4bc4 req-a87ed38a-634f-4ed5-a019-660d4bc4248c tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-3d5ef144-d993-4538-9ee4-4883603d4bc4 req-a87ed38a-634f-4ed5-a019-660d4bc4248c tempest-TaggedAttachmentsTest-2138282335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-a50b639a-cb21-4c39-b627-aa7522c1d22d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b9c5cc4-78fb-4384-8bc7-cbb8ef71eff5', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-3d5ef144-d993-4538-9ee4-4883603d4bc4 req-a87ed38a-634f-4ed5-a019-660d4bc4248c tempest-TaggedAttachmentsTest-2138282335 None] attachment_update completed successfully. Jul 23 03:19:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ebb32d51-fc1c-4ca9-a905-f7fb75f1d7b6 tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-1148978854: creating Jul 23 03:19:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ebb32d51-fc1c-4ca9-a905-f7fb75f1d7b6 tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-1148978854: created successfully Jul 23 03:19:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ebb32d51-fc1c-4ca9-a905-f7fb75f1d7b6 tempest-GroupSnapshotsTest-1316974458 None] Create group completed successfully. Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (c94e6ea7-f79c-4937-a4c7-bea87e7cc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c325a0b-bf79-4969-adb6-9559ef58a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c325a0b-bf79-4969-adb6-9559ef58a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876995893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bffea0e4-d75a-4986-b879-8889026c85eb,host='devstack@QuobyteHD#QuobyteHD',id=55825b7a-e2ef-47ef-9da6-e691eef36109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:58Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8948ace7-925d-44dd-b985-71f4460307ed),volume_type_id=8948ace7-925d-44dd-b985-71f4460307ed)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55285529-03e3-4ecb-9d8e-d889dd146768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55285529-03e3-4ecb-9d8e-d889dd146768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2742f0-3a36-419b-b8fe-f3cc14380c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2742f0-3a36-419b-b8fe-f3cc14380c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55825b7a-e2ef-47ef-9da6-e691eef36109', 'volume_name': 'volume-55825b7a-e2ef-47ef-9da6-e691eef36109', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c64fab-e849-4ad3-8d32-950bcddb4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c64fab-e849-4ad3-8d32-950bcddb4fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41406246-8fed-4ef4-8501-cfd3cffbe9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Volume 55825b7a-e2ef-47ef-9da6-e691eef36109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55825b7a-e2ef-47ef-9da6-e691eef36109', 'volume_size': 1} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bffea0e4-d75a-4986-b879-8889026c85eb,created_at=2026-07-23T01:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876995893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bffea0e4-d75a-4986-b879-8889026c85eb,host='devstack@QuobyteHD#QuobyteHD',id=55825b7a-e2ef-47ef-9da6-e691eef36109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:58Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8948ace7-925d-44dd-b985-71f4460307ed),volume_type_id=8948ace7-925d-44dd-b985-71f4460307ed)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Creating volume 55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:58 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:19:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:58 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 1073741824 Jul 23 03:19:58 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a51559d0-ba29-4a40-b406-9f324a6d0bc2 req-5f6f93b9-81e0-47c1-a32c-b5392ab4d5f5 tempest-TaggedAttachmentsTest-2138282335 None] Terminate volume connection completed successfully. Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-a51559d0-ba29-4a40-b406-9f324a6d0bc2 req-5f6f93b9-81e0-47c1-a32c-b5392ab4d5f5 tempest-TaggedAttachmentsTest-2138282335 None] Deleting attachment 9b9c5cc4-78fb-4384-8bc7-cbb8ef71eff5. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:19:59 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 1073741824" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:59 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:19:59 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:59 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.325s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41406246-8fed-4ef4-8501-cfd3cffbe9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55825b7a-e2ef-47ef-9da6-e691eef36109', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08559d2-b238-4e28-b733-1e6da28d43f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Volume volume-55825b7a-e2ef-47ef-9da6-e691eef36109 (55825b7a-e2ef-47ef-9da6-e691eef36109): created successfully Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08559d2-b238-4e28-b733-1e6da28d43f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (c94e6ea7-f79c-4937-a4c7-bea87e7cc635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8ff3c18c-fc75-49a0-820e-c51a75aa6aac tempest-GroupSnapshotsTest-1316974458 None] Created volume successfully. Jul 23 03:20:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] GroupSnapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: creating. Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Group snapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: creating. {{(pid=88466) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Creating offline snapshot 59c56701-4e87-45e6-b552-6b9671d85246 of volume 55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5fcb8b-0fea-4f2b-a80d-3be4f7116ef5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:00 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:00 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:01 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.581s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:01 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 1G Jul 23 03:20:01 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:01 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 1G" returned: 0 in 0.648s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55825b7a-e2ef-47ef-9da6-e691eef36109 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:01 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55825b7a-e2ef-47ef-9da6-e691eef36109 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:01 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:02 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55825b7a-e2ef-47ef-9da6-e691eef36109 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.414s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:02 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:02 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:02 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:02 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.424s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:02 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info Jul 23 03:20:02 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info" returned: 0 in 0.513s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:03 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:03 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:03 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info Jul 23 03:20:03 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:03 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.info" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-aea7d737-8ea6-46c2-9302-e368f00f8590 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: created successfully Jul 23 03:20:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-fa706b1b-0ef4-4818-8dba-ac8b00b6bc15 req-44070d58-1f03-40ae-9859-a3ff908e95e0 tempest-ServerActionsTestOtherA-421707419 None] Terminate volume connection completed successfully. Jul 23 03:20:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-fa706b1b-0ef4-4818-8dba-ac8b00b6bc15 req-44070d58-1f03-40ae-9859-a3ff908e95e0 tempest-ServerActionsTestOtherA-421707419 None] Deleting attachment 4b8c1e13-1fa0-4250-987e-0d5f733bd92d. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Creating volume 1a2267c9-80a9-4900-82e5-ced13d4fe4bd from snapshot 59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] snapshot: 59c56701-4e87-45e6-b552-6b9671d85246, volume: 1a2267c9-80a9-4900-82e5-ced13d4fe4bd, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcb76c-1128-4e78-9175-57db0398d79e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:06 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:06 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:06 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55825b7a-e2ef-47ef-9da6-e691eef36109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35eb2cc-d52f-4c82-a012-f117f2392851]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:06 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:06 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:07 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.552s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:07 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:20:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:07 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd Jul 23 03:20:07 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "cinder-9d6d51e2-89a7-42bd-afb1-6a4753c69d90-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "cinder-9d6d51e2-89a7-42bd-afb1-6a4753c69d90-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:13 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "cinder-quobyte-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" returned: 0 in 6.565s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "cinder-quobyte-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265a609-5947-4e6f-bc7b-700db3790112]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72e681-5dba-4090-86c1-ab417109a0b6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:13 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:13 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:13 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 Jul 23 03:20:13 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:14 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" returned: 0 in 0.564s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:14 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90 Jul 23 03:20:14 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:14 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.807s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:20:14 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Converted 1024.00 MB image at 155.96 MB/s Jul 23 03:20:14 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:14 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd Jul 23 03:20:14 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:14 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" returned: 0 in 0.538s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "cinder-quobyte-9d6d51e2-89a7-42bd-afb1-6a4753c69d90" released by "delete_volume" :: held 1.213s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "cinder-a50b639a-cb21-4c39-b627-aa7522c1d22d-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "cinder-a50b639a-cb21-4c39-b627-aa7522c1d22d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Created reservations ['cb9b1bc7-0b72-43a6-884c-6a6e345d2469', 'c7ab3b5a-cba8-4d42-bb0a-fa173f86b33c', 'a8fd4c0c-cf2e-4f45-9b50-8da096d848a0', '4bf3b7c2-61bc-4025-add4-8b75d02bcd5d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "cinder-quobyte-a50b639a-cb21-4c39-b627-aa7522c1d22d" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:15 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" returned: 0 in 0.545s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" released by "_copy_volume_from_snapshot" :: held 9.058s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "cinder-quobyte-a50b639a-cb21-4c39-b627-aa7522c1d22d" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" released by "_create_volume_from_snapshot" :: held 9.116s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.143s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42f0bb-5669-4512-a867-c8aa66af1d62]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:15 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:15 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:15 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d Jul 23 03:20:15 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ac56f0fc-1683-4e8a-b0d9-bd08b4fa7b55 tempest-GroupSnapshotsTest-1316974458 None] Create group from source-snapshot-cb15aab2-f518-4233-a33e-4c9798e6bae4 completed successfully. Jul 23 03:20:15 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Deleted volume successfully. Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f78b355-da4a-4537-87ef-bb9b4b03036b tempest-ServerActionsTestOtherA-421707419 None] Lock "cinder-9d6d51e2-89a7-42bd-afb1-6a4753c69d90-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:15 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d" returned: 0 in 0.409s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:15 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d Jul 23 03:20:15 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:15 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a50b639a-cb21-4c39-b627-aa7522c1d22d" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "cinder-quobyte-a50b639a-cb21-4c39-b627-aa7522c1d22d" released by "delete_volume" :: held 0.728s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Created reservations ['95f49653-6967-43a7-a7b0-542f6a727338', '349f73f9-ed59-4065-a669-4bd42b98d354', '728aeada-1677-4394-a6d7-281f27d9a54b', 'f7499494-5db8-4f87-a505-9499e753c5bb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:16 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:16 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:16 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.364s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Deleted volume successfully. Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ababfcfa-b739-4245-a62c-ec63a04d1e1a tempest-TaggedAttachmentsTest-2138282335 None] Lock "cinder-a50b639a-cb21-4c39-b627-aa7522c1d22d-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8541ed3-bf24-41a6-b677-0757dc7a708f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:16 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd Jul 23 03:20:16 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:17 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" returned: 0 in 0.564s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:17 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd Jul 23 03:20:17 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:17 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1a2267c9-80a9-4900-82e5-ced13d4fe4bd" released by "delete_volume" :: held 0.919s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['86096a38-5801-438e-98da-ac6353f70a65'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:17 devstack cinder-volume[88466]: WARNING cinder.quota [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-446918254 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-446918254, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:17 devstack cinder-volume[88466]: WARNING cinder.quota [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-446918254 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-446918254, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['7ac03728-a975-4930-a649-e013c782d4af', 'd32185c9-616b-488a-875d-6a9f8f0fd99a', 'f6fd9f10-ab55-45b3-afdd-8a4f2b2f5604', 'd70ffc45-b73c-4e7c-a764-1d127e9c8a28'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:17 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:17 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:18 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] group_snapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: deleting Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9073e8bb-55d8-4786-af61-e98fbfdea833 tempest-GroupSnapshotsTest-1316974458 None] Delete group completed successfully. Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] group_snapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: deleting {{(pid=88466) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Deleting offline snapshot 59c56701-4e87-45e6-b552-6b9671d85246 of volume 55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] snapshot_file for this snap is: volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a739b-c07f-4349-84f0-50d92ae379f2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:18 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:18 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:18 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55825b7a-e2ef-47ef-9da6-e691eef36109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b496a-351d-4b07-8178-80433e9231e7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:18 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:18 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:19 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.450s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:19 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:19 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:19 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.689s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:20 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246 Jul 23 03:20:20 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:20 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109.59c56701-4e87-45e6-b552-6b9671d85246" returned: 0 in 0.474s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-59c56701-4e87-45e6-b552-6b9671d85246" released by "_delete_snapshot" :: held 2.194s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" released by "delete_snapshot" :: held 2.243s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:20 devstack cinder-volume[88466]: WARNING cinder.quota [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-446918254 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-446918254, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:20 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['f8c8fccf-326d-4e25-85d3-bd2a12b077cc', '0a477b73-7a51-4128-99e4-0b1dc20aec8a', 'd2fb304a-1014-4891-bf81-e48eceaf1789', '29eb7cc1-396e-4734-8324-8f57e63ef992'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e110897d-2387-49d2-a1cb-2a55e0797b4b tempest-GroupSnapshotsTest-1316974458 None] group_snapshot cb15aab2-f518-4233-a33e-4c9798e6bae4: deleted successfully Jul 23 03:20:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" acquired by "delete_volume" :: waited 0.047s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:22 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79a7c72-2de4-419e-a113-fbb8f7bddfdb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:22 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:22 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:23 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.544s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:23 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109 Jul 23 03:20:23 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:23 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-55825b7a-e2ef-47ef-9da6-e691eef36109" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-55825b7a-e2ef-47ef-9da6-e691eef36109" released by "delete_volume" :: held 1.200s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['55afebad-dcae-4c19-8fbe-99a3b1248121'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:23 devstack cinder-volume[88466]: WARNING cinder.db.api [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-446918254'] Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['04600bee-9523-43d9-a22e-809ea177e3e6', 'f5d8f2a6-764c-4ea7-a10e-739e5b4bc16a', 'b33a5ceb-1528-4bd3-b14f-358af9c7257b', 'bcc2eda1-b8bd-48c4-a6a9-d25285168bc9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:23 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:23 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:24 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.351s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:24 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-04ed3b33-8795-4613-b95d-422f6bcc6d47 tempest-GroupSnapshotsTest-1316974458 None] Delete group completed successfully. Jul 23 03:20:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-eb4c7774-8d9c-4c30-969b-fe5393072431 tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-2097213668: creating Jul 23 03:20:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-eb4c7774-8d9c-4c30-969b-fe5393072431 tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-2097213668: created successfully Jul 23 03:20:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-eb4c7774-8d9c-4c30-969b-fe5393072431 tempest-GroupSnapshotsTest-1316974458 None] Create group completed successfully. Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (a9689049-0b0b-44cf-bd97-108cbd624ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a02a694-7c4e-4613-8c0b-c5d9526c6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a02a694-7c4e-4613-8c0b-c5d9526c6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469080653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adcf632-0ffc-47bb-9212-aff34b668985,host='devstack@QuobyteHD#QuobyteHD',id=6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:27Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5686475-0f3e-46d9-97f8-76857e77a92b),volume_type_id=d5686475-0f3e-46d9-97f8-76857e77a92b)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cd548-b17d-44eb-b2a1-1b4d7a3a7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cd548-b17d-44eb-b2a1-1b4d7a3a7b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d1a720-4cba-45fc-a884-b6ed73146763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d1a720-4cba-45fc-a884-b6ed73146763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4', 'volume_name': 'volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daa6536-0b8d-406a-bcff-b3860c7d4dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daa6536-0b8d-406a-bcff-b3860c7d4dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce55b12d-079f-4bb1-877c-da5c8544eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:27 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Volume 6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4', 'volume_size': 1} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3adcf632-0ffc-47bb-9212-aff34b668985,created_at=2026-07-23T01:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469080653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adcf632-0ffc-47bb-9212-aff34b668985,host='devstack@QuobyteHD#QuobyteHD',id=6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:27Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5686475-0f3e-46d9-97f8-76857e77a92b),volume_type_id=d5686475-0f3e-46d9-97f8-76857e77a92b)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Creating volume 6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:27 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:27 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 1073741824 Jul 23 03:20:27 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:28 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 1073741824" returned: 0 in 0.767s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:28 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 Jul 23 03:20:28 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:28 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" returned: 0 in 0.351s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce55b12d-079f-4bb1-877c-da5c8544eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9ec02-700e-4694-8aa7-38e87c42b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:28 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Volume volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 (6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4): created successfully Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9ec02-700e-4694-8aa7-38e87c42b02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (a9689049-0b0b-44cf-bd97-108cbd624ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-32d16172-3096-4324-92cf-4149e23a6478 tempest-GroupSnapshotsTest-1316974458 None] Created volume successfully. Jul 23 03:20:30 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (98e74daf-9821-469d-821b-2a49e974fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f907396-b2ad-4dc0-859a-35202c47a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f907396-b2ad-4dc0-859a-35202c47a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88218475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adcf632-0ffc-47bb-9212-aff34b668985,host='devstack@QuobyteHD#QuobyteHD',id=07afc1de-68dc-4f93-84cd-8d635766fbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:31Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5686475-0f3e-46d9-97f8-76857e77a92b),volume_type_id=d5686475-0f3e-46d9-97f8-76857e77a92b)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199bb0cc-da7b-46dc-a6f2-97a0390abdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199bb0cc-da7b-46dc-a6f2-97a0390abdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0eddaa-cd9e-4b5a-a487-ffe310efa1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0eddaa-cd9e-4b5a-a487-ffe310efa1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07afc1de-68dc-4f93-84cd-8d635766fbd0', 'volume_name': 'volume-07afc1de-68dc-4f93-84cd-8d635766fbd0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0f2121-aeea-4839-854f-41cc9f620bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0f2121-aeea-4839-854f-41cc9f620bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6046228d-1d38-481d-bd40-abf6ebcae159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:31 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Volume 07afc1de-68dc-4f93-84cd-8d635766fbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07afc1de-68dc-4f93-84cd-8d635766fbd0', 'volume_size': 1} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3adcf632-0ffc-47bb-9212-aff34b668985,created_at=2026-07-23T01:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88218475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adcf632-0ffc-47bb-9212-aff34b668985,host='devstack@QuobyteHD#QuobyteHD',id=07afc1de-68dc-4f93-84cd-8d635766fbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:31Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5686475-0f3e-46d9-97f8-76857e77a92b),volume_type_id=d5686475-0f3e-46d9-97f8-76857e77a92b)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Creating volume 07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:31 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:31 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 1073741824 Jul 23 03:20:31 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:31 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 1073741824" returned: 0 in 0.624s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:31 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 Jul 23 03:20:31 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:32 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0" returned: 0 in 0.435s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6046228d-1d38-481d-bd40-abf6ebcae159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07afc1de-68dc-4f93-84cd-8d635766fbd0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98bd41b-6f88-45a0-ace6-c11a5a212096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Volume volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 (07afc1de-68dc-4f93-84cd-8d635766fbd0): created successfully Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98bd41b-6f88-45a0-ace6-c11a5a212096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (98e74daf-9821-469d-821b-2a49e974fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:32 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3039f1fd-4f91-4493-b9ed-64f9a4ba17f3 tempest-GroupSnapshotsTest-1316974458 None] Created volume successfully. Jul 23 03:20:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0d3e7453-9e1e-4d73-8bd8-aed28f4debc6 tempest-GroupSnapshotsTest-1316974458 None] Update group completed successfully. Jul 23 03:20:33 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Flow 'volume_create_manager' (4c50322f-a47b-4cc5-b612-56b1c942db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c079bbb2-2ea4-4d28-9577-1d955211e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c079bbb2-2ea4-4d28-9577-1d955211e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1094448051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75df6623-a697-48b2-95cb-084e8275b5f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a0144b4f40240caa1d731926d712195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:34Z,use_quota=True,user_id='2c7a84e4d067454a80f82689625f7d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79b8874-ecdf-42b4-aff7-a04e499cdf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79b8874-ecdf-42b4-aff7-a04e499cdf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df041a3-3c13-49d8-b59d-5e9e02c88ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df041a3-3c13-49d8-b59d-5e9e02c88ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75df6623-a697-48b2-95cb-084e8275b5f1', 'volume_name': 'volume-75df6623-a697-48b2-95cb-084e8275b5f1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c52207-01f0-469f-a6b1-1d6317e39a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c52207-01f0-469f-a6b1-1d6317e39a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a9c3c-b92c-4eea-97dd-e3bc0f2fd3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Volume 75df6623-a697-48b2-95cb-084e8275b5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75df6623-a697-48b2-95cb-084e8275b5f1', 'volume_size': 1} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1094448051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75df6623-a697-48b2-95cb-084e8275b5f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a0144b4f40240caa1d731926d712195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:34Z,use_quota=True,user_id='2c7a84e4d067454a80f82689625f7d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Creating volume 75df6623-a697-48b2-95cb-084e8275b5f1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:34 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:34 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 1073741824 Jul 23 03:20:34 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:34 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 1073741824" returned: 0 in 0.528s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:34 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 Jul 23 03:20:34 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:34 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5c98d9e6-33ed-4dab-afac-11c00d87ee26 tempest-GroupSnapshotsTest-1316974458 None] Update group completed successfully. Jul 23 03:20:34 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a9c3c-b92c-4eea-97dd-e3bc0f2fd3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75df6623-a697-48b2-95cb-084e8275b5f1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fad2cf-d1a0-4a53-958c-7a1ee3de48a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:34 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Volume volume-75df6623-a697-48b2-95cb-084e8275b5f1 (75df6623-a697-48b2-95cb-084e8275b5f1): created successfully Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fad2cf-d1a0-4a53-958c-7a1ee3de48a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Flow 'volume_create_manager' (4c50322f-a47b-4cc5-b612-56b1c942db83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:34 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-d3469123-e684-4ec0-8034-d6f270646b2e req-b3437100-9ad8-4cfa-a787-907c7b77db20 tempest-VolumesGetTestJSON-1317352479 None] Created volume successfully. Jul 23 03:20:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-50234501-b750-42b4-a4f7-e16031ecd128 tempest-GroupSnapshotsTest-1316974458 None] Update group completed successfully. Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Acquiring lock "cinder-75df6623-a697-48b2-95cb-084e8275b5f1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "cinder-75df6623-a697-48b2-95cb-084e8275b5f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Acquiring lock "cinder-quobyte-75df6623-a697-48b2-95cb-084e8275b5f1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "cinder-quobyte-75df6623-a697-48b2-95cb-084e8275b5f1" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f53b1-c3c5-4b92-a65e-ce9968702a9e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:36 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 Jul 23 03:20:36 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:36 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1" returned: 0 in 0.398s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:36 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1 Jul 23 03:20:36 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:37 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-75df6623-a697-48b2-95cb-084e8275b5f1" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "cinder-quobyte-75df6623-a697-48b2-95cb-084e8275b5f1" released by "delete_volume" :: held 0.709s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.quota [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Created reservations ['d7b7ee11-b1a3-472b-9949-8dd5e5184ef8', '071b78de-9556-48ce-a6f2-e2877904d0e6', 'd535c0de-5296-4bc7-8fbc-524163a8c5f4', '7c8eb7a5-37a0-4c91-b2d6-8c4158403896'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:37 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:37 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:37 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b018d1db-7474-4e2a-9fcc-84bd1080bb21 tempest-GroupSnapshotsTest-1316974458 None] Update group completed successfully. Jul 23 03:20:37 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.manager [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:37 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Deleted volume successfully. Jul 23 03:20:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a20d2381-8829-4992-b159-b9e18818af02 req-eff1a8f0-2374-43bb-a1f1-27efd58772a3 tempest-VolumesGetTestJSON-1317352479 None] Lock "cinder-75df6623-a697-48b2-95cb-084e8275b5f1-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] GroupSnapshot 28339e44-3c70-48e0-a835-260e2ce88816: creating. Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Group snapshot 28339e44-3c70-48e0-a835-260e2ce88816: creating. {{(pid=88466) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Creating offline snapshot 1528e8ba-3040-45c9-a4a8-62f25d17e115 of volume 6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a3a25c-ea2c-4e5d-bb31-6a09127940d2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:39 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 Jul 23 03:20:39 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:39 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" returned: 0 in 0.459s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:39 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 1G Jul 23 03:20:39 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:39 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 1G" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:39 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 Jul 23 03:20:39 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:40 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115" returned: 0 in 0.355s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:40 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 Jul 23 03:20:40 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:40 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:40 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info Jul 23 03:20:40 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:40 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info" returned: 0 in 0.305s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:40 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info Jul 23 03:20:40 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:41 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.info" returned: 0 in 0.318s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Creating offline snapshot aca77a96-9b4d-420c-96ca-78870ebaf4f8 of volume 07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116a350-5561-41c4-a223-f899b2cfd88e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:41 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 Jul 23 03:20:41 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:41 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (042c9c69-9348-44ed-82cf-e4f58745525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02ef7a3-93c0-45f3-994d-ffc222b3b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0" returned: 0 in 0.602s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02ef7a3-93c0-45f3-994d-ffc222b3b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209196426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f97939e-7af7-4154-b39a-c4f218864232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:42Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a0488-3f53-495e-af61-79b21fbcedee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:41 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 1G Jul 23 03:20:41 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a0488-3f53-495e-af61-79b21fbcedee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c72850-1ce3-47a2-8067-8213411330ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c72850-1ce3-47a2-8067-8213411330ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f97939e-7af7-4154-b39a-c4f218864232', 'volume_name': 'volume-3f97939e-7af7-4154-b39a-c4f218864232', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa046098-7d82-4674-b2c1-4720e57cca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa046098-7d82-4674-b2c1-4720e57cca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389cfbb6-a88f-48b8-b3b5-62a639e087cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Volume 3f97939e-7af7-4154-b39a-c4f218864232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f97939e-7af7-4154-b39a-c4f218864232', 'volume_size': 1} Jul 23 03:20:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:42 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 1G" returned: 0 in 0.603s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:42 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 Jul 23 03:20:42 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:42 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:42 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:42 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 Jul 23 03:20:42 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:43 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8" returned: 0 in 0.267s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:43 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info Jul 23 03:20:43 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:43 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:43 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:43 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info Jul 23 03:20:43 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:43 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.info" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209196426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f97939e-7af7-4154-b39a-c4f218864232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:42Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Creating volume 3f97939e-7af7-4154-b39a-c4f218864232 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:43 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:43 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 1073741824 Jul 23 03:20:43 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e0a0759a-be06-48c2-8a39-c8ffacf4b6a2 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot 28339e44-3c70-48e0-a835-260e2ce88816: created successfully Jul 23 03:20:44 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 1073741824" returned: 0 in 0.485s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:44 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 Jul 23 03:20:44 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot 28339e44-3c70-48e0-a835-260e2ce88816: deleting Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot 28339e44-3c70-48e0-a835-260e2ce88816: deleting {{(pid=88466) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:44 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-1528e8ba-3040-45c9-a4a8-62f25d17e115" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389cfbb6-a88f-48b8-b3b5-62a639e087cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f97939e-7af7-4154-b39a-c4f218864232', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6354cd-7828-426a-aee5-c2fe746b1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:44 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Volume volume-3f97939e-7af7-4154-b39a-c4f218864232 (3f97939e-7af7-4154-b39a-c4f218864232): created successfully Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6354cd-7828-426a-aee5-c2fe746b1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (042c9c69-9348-44ed-82cf-e4f58745525f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1528e8ba-3040-45c9-a4a8-62f25d17e115" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Deleting offline snapshot 1528e8ba-3040-45c9-a4a8-62f25d17e115 of volume 6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] snapshot_file for this snap is: volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c5058-2f3a-4a1f-b275-fc22ddbeabf3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7bc493af-7bf0-4a46-b90f-8254abaa3b54 tempest-VolumesTestJSON-1963050597 None] Created volume successfully. Jul 23 03:20:44 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 Jul 23 03:20:44 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:44 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88cc079-0154-4814-9f99-b5cf5e5e1ec7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:45 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 Jul 23 03:20:45 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:45 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" returned: 0 in 0.461s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:45 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 Jul 23 03:20:45 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Flow 'volume_create_manager' (4766cf3c-d30b-4fc4-b34c-e8ec1e7f46e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd762dcb-71ab-41d3-972e-7a39d684acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd762dcb-71ab-41d3-972e-7a39d684acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-959242611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b06aca5-60dd-45c4-b138-73d13dfa64cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d57ef7729407f956cd8f4b9cebedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:46Z,use_quota=True,user_id='2aaf6d3f94c44547bc2018b0059b9304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b548e1d-c01e-42d1-a7ad-dd6d38714847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b548e1d-c01e-42d1-a7ad-dd6d38714847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a59421-a82e-4e35-b6fa-19e33366fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a59421-a82e-4e35-b6fa-19e33366fca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b06aca5-60dd-45c4-b138-73d13dfa64cf', 'volume_name': 'volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be38c799-fbde-42e1-a4b8-ace3a61e4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be38c799-fbde-42e1-a4b8-ace3a61e4c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e165297b-71ab-4877-9527-4e4b2398f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Volume 9b06aca5-60dd-45c4-b138-73d13dfa64cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf', 'volume_size': 1} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-959242611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b06aca5-60dd-45c4-b138-73d13dfa64cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242d57ef7729407f956cd8f4b9cebedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:46Z,use_quota=True,user_id='2aaf6d3f94c44547bc2018b0059b9304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Creating volume 9b06aca5-60dd-45c4-b138-73d13dfa64cf {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:45 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:45 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf 1073741824 Jul 23 03:20:45 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:45 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (1615fe85-f054-41f0-a30a-38ae7c583460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cca2b2-1abb-4959-9316-e95e3fe72bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115" returned: 0 in 0.449s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1cca2b2-1abb-4959-9316-e95e3fe72bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468042709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcd08d1-5084-4565-9c8c-375f846eaa2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:46Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115 Jul 23 03:20:45 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113fecf-0e0e-4941-be7f-4e915d3669fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113fecf-0e0e-4941-be7f-4e915d3669fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f036ce4-ea87-4d75-999e-34c3a5f80893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f036ce4-ea87-4d75-999e-34c3a5f80893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcd08d1-5084-4565-9c8c-375f846eaa2a', 'volume_name': 'volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d713e94b-faee-4f0c-888f-674c71bcd52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d713e94b-faee-4f0c-888f-674c71bcd52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4bc57f-b596-4b77-bd21-9466f3a118f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Volume 0fcd08d1-5084-4565-9c8c-375f846eaa2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a', 'volume_size': 1} Jul 23 03:20:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:46 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4.1528e8ba-3040-45c9-a4a8-62f25d17e115" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-1528e8ba-3040-45c9-a4a8-62f25d17e115" released by "_delete_snapshot" :: held 1.724s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" released by "delete_snapshot" :: held 1.782s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-aca77a96-9b4d-420c-96ca-78870ebaf4f8" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-aca77a96-9b4d-420c-96ca-78870ebaf4f8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Deleting offline snapshot aca77a96-9b4d-420c-96ca-78870ebaf4f8 of volume 07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] snapshot_file for this snap is: volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4facd954-765c-4430-9fb0-28c1638f7b83]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:46 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf 1073741824" returned: 0 in 0.502s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:46 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf Jul 23 03:20:46 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:46 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 Jul 23 03:20:46 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:46 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468042709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcd08d1-5084-4565-9c8c-375f846eaa2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:46Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Creating volume 0fcd08d1-5084-4565-9c8c-375f846eaa2a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:46 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a 1073741824 Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e165297b-71ab-4877-9527-4e4b2398f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:46 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57967667-7df0-4675-a20a-caae30b1f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Volume volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf (9b06aca5-60dd-45c4-b138-73d13dfa64cf): created successfully Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57967667-7df0-4675-a20a-caae30b1f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Flow 'volume_create_manager' (4766cf3c-d30b-4fc4-b34c-e8ec1e7f46e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:46 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-68479a93-eb25-4fde-b1f8-0b17050ad7e4 tempest-AttachVolumeShelveTestJSON-1841244794 None] Created volume successfully. Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8" returned: 0 in 0.432s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07afc1de-68dc-4f93-84cd-8d635766fbd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e949f14-1c00-423c-8c9a-e38d0729075e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:46 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 Jul 23 03:20:46 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:47 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a 1073741824" returned: 0 in 0.565s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:47 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0" returned: 0 in 0.438s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:47 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 Jul 23 03:20:47 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:47 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a Jul 23 03:20:47 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:47 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4bc57f-b596-4b77-bd21-9466f3a118f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70a15cd-0451-4d7d-b1c0-04c2e6489fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Volume volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a (0fcd08d1-5084-4565-9c8c-375f846eaa2a): created successfully Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70a15cd-0451-4d7d-b1c0-04c2e6489fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (1615fe85-f054-41f0-a30a-38ae7c583460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9715fe5b-cfe7-4b85-9276-6f8e1f6e9d48 tempest-VolumesTestJSON-1963050597 None] Created volume successfully. Jul 23 03:20:47 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:47 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8 Jul 23 03:20:47 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:47 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:47 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:48 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 8 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:20:48 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0.aca77a96-9b4d-420c-96ca-78870ebaf4f8" returned: 0 in 0.554s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-aca77a96-9b4d-420c-96ca-78870ebaf4f8" released by "_delete_snapshot" :: held 2.046s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" released by "delete_snapshot" :: held 2.076s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:48 devstack cinder-volume[88466]: WARNING cinder.quota [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-910286509 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-910286509, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:48 devstack cinder-volume[88466]: WARNING cinder.quota [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-910286509 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-910286509, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['461df770-028b-4278-bba6-2f4d6bde76a2', 'ee471a75-b2dd-4d09-a171-f681c22f51c6', 'dea781e9-10a0-4ad4-b792-f955acf6652a', '1c42cbdf-d551-4985-93d9-9d801bfa09d9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['4ff2cc81-aa58-4f74-84f2-8816d3e78962', '7a39999a-4298-436f-a52e-a7dc3b1207c3', '4fc07f75-de2a-44b2-840e-88f6e983407f', '14c6a0b4-efd6-4020-a4c1-83dce85b0782'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ac79c67d-2689-464a-849c-2d449e02b973 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot 28339e44-3c70-48e0-a835-260e2ce88816: deleted successfully Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (75dcd99f-46d3-4683-90e2-96f10033d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65525da-0500-48e3-b7c8-fcb6c41b991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65525da-0500-48e3-b7c8-fcb6c41b991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1685196714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b639fe-e768-4d29-ae6f-e619586fd22e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:49Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde70c68-a526-425c-aeaa-cb3c4f6bea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde70c68-a526-425c-aeaa-cb3c4f6bea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e2867-b002-4e75-9dbe-a1ce339ae530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e2867-b002-4e75-9dbe-a1ce339ae530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b639fe-e768-4d29-ae6f-e619586fd22e', 'volume_name': 'volume-e4b639fe-e768-4d29-ae6f-e619586fd22e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ea42d9-bd0d-4b78-a977-6ee79b454546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ea42d9-bd0d-4b78-a977-6ee79b454546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba0644e-d165-4325-a8c5-76d9f81d3281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:48 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Volume e4b639fe-e768-4d29-ae6f-e619586fd22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b639fe-e768-4d29-ae6f-e619586fd22e', 'volume_size': 1} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1685196714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b639fe-e768-4d29-ae6f-e619586fd22e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d5ab309dc61405ebdd943406a0eabf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:49Z,use_quota=True,user_id='2a7de6ed38d54041a4545c9ba058a46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Creating volume e4b639fe-e768-4d29-ae6f-e619586fd22e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:49 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:49 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e 1073741824 Jul 23 03:20:49 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" acquired by "delete_volume" :: waited 0.045s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1c17b-050b-42b0-bf00-cbad7aa1bc1c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:49 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e 1073741824" returned: 0 in 0.905s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:50 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 Jul 23 03:20:50 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:50 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e Jul 23 03:20:50 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:50 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0" returned: 0 in 0.526s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:50 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba0644e-d165-4325-a8c5-76d9f81d3281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b639fe-e768-4d29-ae6f-e619586fd22e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:50 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0 Jul 23 03:20:50 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75669c79-e0c6-4ac8-a288-2be5cfb289b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Volume volume-e4b639fe-e768-4d29-ae6f-e619586fd22e (e4b639fe-e768-4d29-ae6f-e619586fd22e): created successfully Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75669c79-e0c6-4ac8-a288-2be5cfb289b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Flow 'volume_create_manager' (75dcd99f-46d3-4683-90e2-96f10033d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ef82c1d1-0745-4870-a7f7-33ca20487567 tempest-VolumesTestJSON-1963050597 None] Created volume successfully. Jul 23 03:20:50 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-07afc1de-68dc-4f93-84cd-8d635766fbd0" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-07afc1de-68dc-4f93-84cd-8d635766fbd0" released by "delete_volume" :: held 1.094s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a65b9-cf9a-4b33-807d-cc10414e4e55]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:51 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 Jul 23 03:20:51 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:51 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" returned: 0 in 0.612s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:51 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4 Jul 23 03:20:51 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:51 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" returned: 0 in 0.420s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-6de1dd73-3ca3-42f4-8601-d2fa04ba6fc4" released by "delete_volume" :: held 1.146s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=113,cinder:UPDATE=91,cinder:INSERT=26,cinder:DELETE=6 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=100,cinder:UPDATE=115,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['d313efdc-1122-49fb-8e0b-e09bbe5822c1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:52 devstack cinder-volume[88466]: WARNING cinder.quota [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-910286509 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-910286509, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['f44ab012-6985-41de-87fe-c9b9e06536e4', '7d64c9e7-b8f2-4795-a836-4b417c5c0e69', 'e602aa88-39e3-4739-a944-e369bd3d926c', 'b963d8df-9223-4cb8-9aab-6df5222776ff'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['90453c11-090b-405d-acef-9177e67e2214', '31185da8-77cb-4c3c-aea6-fa3b36b2cf71', '240f6e18-08ec-4990-89fe-bd3c4d1a2a73', '34fa7e32-89c7-4d29-a01b-0c17bd80e403'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-e4b639fe-e768-4d29-ae6f-e619586fd22e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "cinder-e4b639fe-e768-4d29-ae6f-e619586fd22e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-quobyte-e4b639fe-e768-4d29-ae6f-e619586fd22e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-e4b639fe-e768-4d29-ae6f-e619586fd22e" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09560f7-f048-414f-9ad6-2cca28bd9d74]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:52 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:52 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:52 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e Jul 23 03:20:52 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:53 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.555s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f4a1351a-6e08-4551-9da0-ea82bdc0ae68 tempest-GroupSnapshotsTest-1316974458 None] Delete group completed successfully. Jul 23 03:20:53 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e" returned: 0 in 0.762s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:53 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e Jul 23 03:20:53 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:53 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4b639fe-e768-4d29-ae6f-e619586fd22e" returned: 0 in 0.575s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-e4b639fe-e768-4d29-ae6f-e619586fd22e" released by "delete_volume" :: held 1.415s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Created reservations ['2c29c154-c9de-437a-9dea-90d9148073c1', 'a6121948-ce48-48da-811f-8889aa6b8328', 'b4b451dc-8595-4dea-b1e7-4ed7cc1da1b6', '09d9ed11-c2ef-41fc-8d36-5dea2e19cbe7'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:54 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:54 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b043c28f-4b65-4720-8c7a-46a8080cbe4c tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-1293164248: creating Jul 23 03:20:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b043c28f-4b65-4720-8c7a-46a8080cbe4c tempest-GroupSnapshotsTest-1316974458 None] Group tempest-GroupSnapshotsTest-Group-1293164248: created successfully Jul 23 03:20:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b043c28f-4b65-4720-8c7a-46a8080cbe4c tempest-GroupSnapshotsTest-1316974458 None] Create group completed successfully. Jul 23 03:20:54 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.327s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Deleted volume successfully. Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8517e1aa-25c1-4b7e-b761-c2b2b9f8162a tempest-VolumesTestJSON-1963050597 None] Lock "cinder-e4b639fe-e768-4d29-ae6f-e619586fd22e-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-0fcd08d1-5084-4565-9c8c-375f846eaa2a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-0fcd08d1-5084-4565-9c8c-375f846eaa2a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-quobyte-0fcd08d1-5084-4565-9c8c-375f846eaa2a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-0fcd08d1-5084-4565-9c8c-375f846eaa2a" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebee7ca-36e0-46bc-a46e-3079efb9a622]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:55 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a Jul 23 03:20:55 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:55 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:55 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a Jul 23 03:20:55 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:56 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0fcd08d1-5084-4565-9c8c-375f846eaa2a" returned: 0 in 0.604s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-0fcd08d1-5084-4565-9c8c-375f846eaa2a" released by "delete_volume" :: held 1.158s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Created reservations ['10b029f1-f1cb-40fc-9ce8-a8bb355390a1', '8eb27b23-c86e-4736-85c6-479e76b3c6f1', 'f02e6c57-f95c-442c-8fa8-d03c0adf9ac3', '8550f293-18d7-4af1-9444-9b8ce378f793'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:56 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:56 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (4d07792c-3624-4a6b-8de3-a7c1712c552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdc5d5-59d6-4bb0-83a5-6ff82f208e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdc5d5-59d6-4bb0-83a5-6ff82f208e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328109281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73935444-1390-46fc-a2e7-03e1de3b0afb,host='devstack@QuobyteHD#QuobyteHD',id=c24ea03b-7222-480d-8d95-770ce10afa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:56Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43126fc2-398a-4a5d-a7cb-770bd6f95666),volume_type_id=43126fc2-398a-4a5d-a7cb-770bd6f95666)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a016a88-2817-4fb7-8a1d-6b1af7800cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a016a88-2817-4fb7-8a1d-6b1af7800cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab7fba9-76f9-42a4-9775-ce8b132eecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab7fba9-76f9-42a4-9775-ce8b132eecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24ea03b-7222-480d-8d95-770ce10afa1b', 'volume_name': 'volume-c24ea03b-7222-480d-8d95-770ce10afa1b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10df28ed-2b92-484c-aa85-43866774603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10df28ed-2b92-484c-aa85-43866774603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcbacfd2-a630-4eb5-a40e-b9ec6f5c3f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Volume c24ea03b-7222-480d-8d95-770ce10afa1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24ea03b-7222-480d-8d95-770ce10afa1b', 'volume_size': 1} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73935444-1390-46fc-a2e7-03e1de3b0afb,created_at=2026-07-23T01:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328109281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73935444-1390-46fc-a2e7-03e1de3b0afb,host='devstack@QuobyteHD#QuobyteHD',id=c24ea03b-7222-480d-8d95-770ce10afa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36073fd26cc548c68b43dfe894212a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:56Z,use_quota=True,user_id='c3cf1b726e8341adbcc164bbcc9f4e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43126fc2-398a-4a5d-a7cb-770bd6f95666),volume_type_id=43126fc2-398a-4a5d-a7cb-770bd6f95666)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Creating volume c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:56 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:20:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:56 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b 1073741824 Jul 23 03:20:56 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:57 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.521s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Deleted volume successfully. Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-abc44614-a1ff-48bd-97b4-9ad7ba6a6bc7 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-0fcd08d1-5084-4565-9c8c-375f846eaa2a-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-3f97939e-7af7-4154-b39a-c4f218864232-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-3f97939e-7af7-4154-b39a-c4f218864232-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "cinder-quobyte-3f97939e-7af7-4154-b39a-c4f218864232" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-3f97939e-7af7-4154-b39a-c4f218864232" acquired by "delete_volume" :: waited 0.049s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:57 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba3fe1-0934-4f46-a860-08b6079fa724]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b 1073741824" returned: 0 in 0.851s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:57 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b Jul 23 03:20:57 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:57 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 Jul 23 03:20:57 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:58 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b" returned: 0 in 0.605s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcbacfd2-a630-4eb5-a40e-b9ec6f5c3f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24ea03b-7222-480d-8d95-770ce10afa1b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560521a-302e-46eb-a584-68770c293010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Volume volume-c24ea03b-7222-480d-8d95-770ce10afa1b (c24ea03b-7222-480d-8d95-770ce10afa1b): created successfully Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2560521a-302e-46eb-a584-68770c293010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Flow 'volume_create_manager' (4d07792c-3624-4a6b-8de3-a7c1712c552f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-45b0f0d5-0554-4ac7-b582-42095447e1ba tempest-GroupSnapshotsTest-1316974458 None] Created volume successfully. Jul 23 03:20:58 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232" returned: 0 in 0.806s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:58 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232 Jul 23 03:20:58 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:58 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f97939e-7af7-4154-b39a-c4f218864232" returned: 0 in 0.327s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-quobyte-3f97939e-7af7-4154-b39a-c4f218864232" released by "delete_volume" :: held 1.213s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Created reservations ['f1bdc994-625d-49e5-b8f8-659b524e2824', '2892c3c3-3196-4937-adde-f70891edb0b7', '99a024fd-738a-4464-9a62-0302e48eb79f', 'acc7d040-9c9e-440d-9414-63cd192fb705'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:58 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:20:58 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:59 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.638s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Deleted volume successfully. Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68377c2b-cb61-4c0c-b35b-5384a16b0736 tempest-VolumesTestJSON-1963050597 None] Lock "cinder-3f97939e-7af7-4154-b39a-c4f218864232-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] GroupSnapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: creating. Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Group snapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: creating. {{(pid=88466) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Creating offline snapshot ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 of volume c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901abf7-aa09-4c41-a46a-ec125661e0c8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:00 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b Jul 23 03:21:00 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:00 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b" returned: 0 in 0.482s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:00 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 1G Jul 23 03:21:00 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:00 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 1G" returned: 0 in 0.460s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ea03b-7222-480d-8d95-770ce10afa1b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:00 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ea03b-7222-480d-8d95-770ce10afa1b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 Jul 23 03:21:00 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:01 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ea03b-7222-480d-8d95-770ce10afa1b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" returned: 0 in 0.401s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:01 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:01 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 Jul 23 03:21:01 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:01 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" returned: 0 in 0.350s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:01 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info Jul 23 03:21:01 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:02 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info" returned: 0 in 0.469s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:02 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:02 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info Jul 23 03:21:02 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-6942ea92-fbf0-4e69-89c6-6e65198d6895 req-fa6384a1-d415-469f-a7e6-01dee3701648 tempest-AttachVolumeShelveTestJSON-1841244794 None] No connector for attachment c2918605-71d6-4fe5-9abd-524eefa069af; skipping storage backend terminate_connection call. {{(pid=88466) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-6942ea92-fbf0-4e69-89c6-6e65198d6895 req-fa6384a1-d415-469f-a7e6-01dee3701648 tempest-AttachVolumeShelveTestJSON-1841244794 None] Deleting attachment c2918605-71d6-4fe5-9abd-524eefa069af. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:21:02 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.info" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7a3a110c-070c-4ee4-962d-b74a52083424 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: created successfully Jul 23 03:21:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: deleting Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: deleting {{(pid=88466) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Deleting offline snapshot ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 of volume c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] snapshot_file for this snap is: volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb29d8e3-921a-48ab-b068-e9c801d3dcbb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:03 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 Jul 23 03:21:03 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:03 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" returned: 0 in 0.535s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24ea03b-7222-480d-8d95-770ce10afa1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656ed65-873e-412e-b9e5-99c5d90637ff]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:04 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b Jul 23 03:21:04 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:04 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b" returned: 0 in 0.577s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:04 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 Jul 23 03:21:04 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:04 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" returned: 0 in 0.451s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:05 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8 Jul 23 03:21:05 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:05 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b.ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" returned: 0 in 0.331s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-ab0f59a5-3089-4625-9bb5-c8d0cf66aad8" released by "_delete_snapshot" :: held 2.049s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" released by "delete_snapshot" :: held 2.079s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:05 devstack cinder-volume[88466]: WARNING cinder.quota [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-640504138 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-640504138, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:05 devstack cinder-volume[88466]: WARNING cinder.quota [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-640504138 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-640504138, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['854f3295-9898-45a3-9e13-4ebc14d2c7e6', '2b7b5869-e661-4be4-903c-0a5efec14713', '207ae0d1-ef67-444c-a5ee-6090629bab9b', 'f229cc91-6754-41c0-8801-9020067f5f9c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-602f2185-a215-4062-86c1-1404c8da1041 tempest-GroupSnapshotsTest-1316974458 None] group_snapshot d4ac701b-d9be-48b5-8154-b6c8cab26aca: deleted successfully Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[818624d0-3c76-4728-9e39-c95cd99174d4]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:06 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b Jul 23 03:21:06 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:06 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b" returned: 0 in 0.512s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:06 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b Jul 23 03:21:06 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:07 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c24ea03b-7222-480d-8d95-770ce10afa1b" returned: 0 in 0.452s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Lock "cinder-quobyte-c24ea03b-7222-480d-8d95-770ce10afa1b" released by "delete_volume" :: held 1.057s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['7bafd9e7-b5e8-49a1-80df-4a50489720a9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:07 devstack cinder-volume[88466]: WARNING cinder.quota [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-640504138 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-640504138, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Created reservations ['bca5065b-a60e-408a-a44e-6bfdd21ef529', 'ec14e8e0-d682-4d84-abe0-1723065eaeb7', 'b8e18bb0-f1bd-49bc-9ee8-2bcd0f3d4de5', 'fd956f83-9cee-4800-8dd0-35cc060980fb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:07 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:07 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:08 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.340s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:08 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7ccdfc87-ccf0-4530-9d81-73fd09f704fb tempest-GroupSnapshotsTest-1316974458 None] Delete group completed successfully. Jul 23 03:21:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9a5dedeb-d364-4237-bb3e-3900654b9d84 tempest-BackendsCapabilitiesAdminTestsJSON-1069337444 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88466) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:21:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-63689cd5-d568-418d-9198-ca4c7a864673 tempest-BackendsCapabilitiesAdminTestsJSON-1069337444 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88466) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:21:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46effa66-d4d0-464f-ae4d-e0066e532a4e tempest-GroupSnapshotsV319Test-1295295431 None] Group tempest-GroupSnapshotsV319Test-Group-1224824591: creating Jul 23 03:21:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46effa66-d4d0-464f-ae4d-e0066e532a4e tempest-GroupSnapshotsV319Test-1295295431 None] Group tempest-GroupSnapshotsV319Test-Group-1224824591: created successfully Jul 23 03:21:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46effa66-d4d0-464f-ae4d-e0066e532a4e tempest-GroupSnapshotsV319Test-1295295431 None] Create group completed successfully. Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Flow 'volume_create_manager' (addd6f53-082c-4e8d-b6f8-73038bd363d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610fa996-bcd3-48ad-8ceb-9c33e4e08598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610fa996-bcd3-48ad-8ceb-9c33e4e08598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279291453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d76738f5-24c0-4b0c-b28c-7b06e95e6375,host='devstack@QuobyteHD#QuobyteHD',id=a577529b-f602-452c-ae6c-007cd42a9162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce89eaa1cc84027ada43b2ddcf24fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:18Z,use_quota=True,user_id='494b0d98804840078c4d29826d38cc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e050cbc7-5ec1-41b5-ab2c-0d1b23210ac8),volume_type_id=e050cbc7-5ec1-41b5-ab2c-0d1b23210ac8)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd73d2e9-be8b-47f7-97cf-0115a0b6ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd73d2e9-be8b-47f7-97cf-0115a0b6ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f556f3-22f8-4517-825a-fd2f1ea3d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f556f3-22f8-4517-825a-fd2f1ea3d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a577529b-f602-452c-ae6c-007cd42a9162', 'volume_name': 'volume-a577529b-f602-452c-ae6c-007cd42a9162', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83001dca-2a7f-4058-804f-83951f84e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83001dca-2a7f-4058-804f-83951f84e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73641d1a-1b0e-4017-b419-b2cb99881cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Volume a577529b-f602-452c-ae6c-007cd42a9162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a577529b-f602-452c-ae6c-007cd42a9162', 'volume_size': 1} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d76738f5-24c0-4b0c-b28c-7b06e95e6375,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279291453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d76738f5-24c0-4b0c-b28c-7b06e95e6375,host='devstack@QuobyteHD#QuobyteHD',id=a577529b-f602-452c-ae6c-007cd42a9162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce89eaa1cc84027ada43b2ddcf24fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:18Z,use_quota=True,user_id='494b0d98804840078c4d29826d38cc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e050cbc7-5ec1-41b5-ab2c-0d1b23210ac8),volume_type_id=e050cbc7-5ec1-41b5-ab2c-0d1b23210ac8)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Creating volume a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:18 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:18 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 1073741824 Jul 23 03:21:18 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (6f51bb38-dac7-4913-aeda-1159f5d2eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b546a3b-869b-4d48-995a-cd449360e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b546a3b-869b-4d48-995a-cd449360e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-167162123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefda3dd-21cd-466f-aea8-916d2d900745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2a2eeb-4991-4c44-96b7-7694dd0764dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2a2eeb-4991-4c44-96b7-7694dd0764dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8341a09b-5e27-4287-9009-4bbd3dedbe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8341a09b-5e27-4287-9009-4bbd3dedbe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefda3dd-21cd-466f-aea8-916d2d900745', 'volume_name': 'volume-eefda3dd-21cd-466f-aea8-916d2d900745', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5772f4f2-d253-4661-aa68-1d769a8634f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5772f4f2-d253-4661-aa68-1d769a8634f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d17ed21-0d41-4da4-8891-1bef59da0e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Volume eefda3dd-21cd-466f-aea8-916d2d900745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefda3dd-21cd-466f-aea8-916d2d900745', 'volume_size': 1} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:19 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 1073741824" returned: 0 in 0.639s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:19 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 Jul 23 03:21:19 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162" returned: 0 in 0.289s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-167162123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefda3dd-21cd-466f-aea8-916d2d900745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Creating volume eefda3dd-21cd-466f-aea8-916d2d900745 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:19 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:19 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 1073741824 Jul 23 03:21:19 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73641d1a-1b0e-4017-b419-b2cb99881cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a577529b-f602-452c-ae6c-007cd42a9162', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e23a1-e9ab-48f6-969f-2e0ee4ac9807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Volume volume-a577529b-f602-452c-ae6c-007cd42a9162 (a577529b-f602-452c-ae6c-007cd42a9162): created successfully Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e23a1-e9ab-48f6-969f-2e0ee4ac9807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Flow 'volume_create_manager' (addd6f53-082c-4e8d-b6f8-73038bd363d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-beb619e6-ecad-4b43-b44e-5de64fc0c942 tempest-GroupSnapshotsV319Test-1295295431 None] Created volume successfully. Jul 23 03:21:20 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 1073741824" returned: 0 in 0.690s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:20 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 Jul 23 03:21:20 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:20 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d17ed21-0d41-4da4-8891-1bef59da0e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefda3dd-21cd-466f-aea8-916d2d900745', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26969de2-2b75-488c-bfb8-30286a73d5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Volume volume-eefda3dd-21cd-466f-aea8-916d2d900745 (eefda3dd-21cd-466f-aea8-916d2d900745): created successfully Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26969de2-2b75-488c-bfb8-30286a73d5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (6f51bb38-dac7-4913-aeda-1159f5d2eef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1925045d-b08d-48fe-950c-a63306dd94ea tempest-AttachVolumeNegativeTest-2811165 None] Created volume successfully. Jul 23 03:21:21 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] GroupSnapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: creating. Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Group snapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: creating. {{(pid=88466) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Creating offline snapshot bd919850-f047-4abc-9eef-dcf919555bed of volume a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ca7d2-66fd-47d1-9daa-67250c0dc84c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:21 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 Jul 23 03:21:21 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4e160daa-6d9f-4a26-9cea-454323106128 req-e1e9cafb-0080-4592-8a1d-20105d26cb09 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:22 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162" returned: 0 in 0.482s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:22 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed 1G Jul 23 03:21:22 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:22 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed 1G" returned: 0 in 0.484s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a577529b-f602-452c-ae6c-007cd42a9162 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:22 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a577529b-f602-452c-ae6c-007cd42a9162 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed Jul 23 03:21:22 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:23 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a577529b-f602-452c-ae6c-007cd42a9162 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed" returned: 0 in 0.363s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:23 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:23 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed Jul 23 03:21:23 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:23 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed" returned: 0 in 0.324s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-216a1e91-1a64-469c-a423-9967fb5899f8 tempest-GroupsTest-940684746 None] Group tempest-Group1-1744656336: creating Jul 23 03:21:23 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info Jul 23 03:21:23 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-216a1e91-1a64-469c-a423-9967fb5899f8 tempest-GroupsTest-940684746 None] Group tempest-Group1-1744656336: created successfully Jul 23 03:21:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-216a1e91-1a64-469c-a423-9967fb5899f8 tempest-GroupsTest-940684746 None] Create group completed successfully. Jul 23 03:21:23 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:23 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:23 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info Jul 23 03:21:23 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:24 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.info" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4e160daa-6d9f-4a26-9cea-454323106128 req-e1e9cafb-0080-4592-8a1d-20105d26cb09 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.824s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4e160daa-6d9f-4a26-9cea-454323106128 req-e1e9cafb-0080-4592-8a1d-20105d26cb09 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-4e160daa-6d9f-4a26-9cea-454323106128 req-e1e9cafb-0080-4592-8a1d-20105d26cb09 tempest-AttachVolumeNegativeTest-2811165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-eefda3dd-21cd-466f-aea8-916d2d900745', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d82f803-8e21-4e40-9066-18f2cfa1e7af', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3f228543-eb1d-46a4-8d8a-b3177159bcac tempest-GroupSnapshotsV319Test-1295295431 None] group_snapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: created successfully Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-4e160daa-6d9f-4a26-9cea-454323106128 req-e1e9cafb-0080-4592-8a1d-20105d26cb09 tempest-AttachVolumeNegativeTest-2811165 None] attachment_update completed successfully. Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] group_snapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: deleting Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] group_snapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: deleting {{(pid=88466) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "cinder-quobyte-bd919850-f047-4abc-9eef-dcf919555bed" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-bd919850-f047-4abc-9eef-dcf919555bed" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Deleting offline snapshot bd919850-f047-4abc-9eef-dcf919555bed of volume a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] snapshot_file for this snap is: volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2061c1-b32c-4b2f-a2fe-6464824518c0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c0dafefa-ffad-409f-9e1b-240b50daa58d tempest-GroupsTest-940684746 None] Group tempest-Group2-223733227: creating Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c0dafefa-ffad-409f-9e1b-240b50daa58d tempest-GroupsTest-940684746 None] Group tempest-Group2-223733227: created successfully Jul 23 03:21:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c0dafefa-ffad-409f-9e1b-240b50daa58d tempest-GroupsTest-940684746 None] Create group completed successfully. Jul 23 03:21:25 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed Jul 23 03:21:25 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:25 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a577529b-f602-452c-ae6c-007cd42a9162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb450dc1-aa7c-47fc-bbfd-92cf988d2616]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:25 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 Jul 23 03:21:25 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:25 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162" returned: 0 in 0.393s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:25 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed Jul 23 03:21:25 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:26 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed" returned: 0 in 0.429s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:26 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed Jul 23 03:21:26 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:26 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (27a64861-783f-4b1c-951f-72904408f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ac4b6e-ac39-4cb6-aa5e-4c7a6bd69d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162.bd919850-f047-4abc-9eef-dcf919555bed" returned: 0 in 0.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ac4b6e-ac39-4cb6-aa5e-4c7a6bd69d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-217679955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a439d6b4-881c-4539-bfb4-f256f97f903f,host='devstack@QuobyteHD#QuobyteHD',id=e25454df-c6d5-4075-b5f8-56a299e410e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:27Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5705e356-fbe8-4c07-9fc9-3516a0c60785),volume_type_id=5705e356-fbe8-4c07-9fc9-3516a0c60785)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10cb46-145a-43fe-b789-e40f7943f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad10cb46-145a-43fe-b789-e40f7943f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4303302-0036-4053-892e-e927b7a77023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4303302-0036-4053-892e-e927b7a77023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25454df-c6d5-4075-b5f8-56a299e410e1', 'volume_name': 'volume-e25454df-c6d5-4075-b5f8-56a299e410e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c068713-2522-47cc-8b33-8861195e035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c068713-2522-47cc-8b33-8861195e035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d387b3b4-ec4c-452f-baf0-e71795ec9436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:26 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Volume e25454df-c6d5-4075-b5f8-56a299e410e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25454df-c6d5-4075-b5f8-56a299e410e1', 'volume_size': 1} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a439d6b4-881c-4539-bfb4-f256f97f903f,created_at=2026-07-23T01:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-217679955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a439d6b4-881c-4539-bfb4-f256f97f903f,host='devstack@QuobyteHD#QuobyteHD',id=e25454df-c6d5-4075-b5f8-56a299e410e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:27Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5705e356-fbe8-4c07-9fc9-3516a0c60785),volume_type_id=5705e356-fbe8-4c07-9fc9-3516a0c60785)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Creating volume e25454df-c6d5-4075-b5f8-56a299e410e1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:26 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-bd919850-f047-4abc-9eef-dcf919555bed" released by "_delete_snapshot" :: held 2.064s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" released by "delete_snapshot" :: held 2.106s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:26 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 1073741824 Jul 23 03:21:26 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:26 devstack cinder-volume[88466]: WARNING cinder.quota [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-370413688 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-370413688, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:26 devstack cinder-volume[88466]: WARNING cinder.quota [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-370413688 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-370413688, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:26 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] Created reservations ['5edd8db0-8d6b-4d46-aa78-d21dade5b93d', '9a1723d2-7988-4731-aa8e-8e09435b5d9f', '0f5b83a1-a67f-434f-91e5-33504c09617d', '022a4dad-dc86-4aee-a1fe-4a63c8365a71'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7005e116-49b7-4f1b-a86e-3cab33fd33e5 tempest-GroupSnapshotsV319Test-1295295431 None] group_snapshot 254cc1d6-c9a6-40a6-bc6f-211d05744724: deleted successfully Jul 23 03:21:27 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 1073741824" returned: 0 in 0.617s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:27 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 Jul 23 03:21:27 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" acquired by "delete_volume" :: waited 0.045s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ffd2e8-a94f-47ba-b7d2-5c08cb941e9b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:27 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 Jul 23 03:21:27 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:28 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1" returned: 0 in 0.589s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:28 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d387b3b4-ec4c-452f-baf0-e71795ec9436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25454df-c6d5-4075-b5f8-56a299e410e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e690cf4c-8a9d-490a-ab14-639d6b76b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162" returned: 0 in 0.491s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:28 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Volume volume-e25454df-c6d5-4075-b5f8-56a299e410e1 (e25454df-c6d5-4075-b5f8-56a299e410e1): created successfully Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e690cf4c-8a9d-490a-ab14-639d6b76b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:28 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162 Jul 23 03:21:28 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (27a64861-783f-4b1c-951f-72904408f692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c9c25431-32e8-4b02-a8f5-183579dbf059 tempest-GroupsTest-940684746 None] Created volume successfully. Jul 23 03:21:28 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a577529b-f602-452c-ae6c-007cd42a9162" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Lock "cinder-quobyte-a577529b-f602-452c-ae6c-007cd42a9162" released by "delete_volume" :: held 0.854s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Created reservations ['f16c3b9e-394c-4464-9fa2-d02cad57fd70'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:28 devstack cinder-volume[88466]: WARNING cinder.quota [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-370413688 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-370413688, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Created reservations ['c8ce4d6f-6a0c-4082-8ef7-8c6a47f69ff2', 'b327d8dc-653b-455d-868a-28698995d8f8', 'c124ef36-68bc-4610-9b69-43fc8571b620', '325a5e86-a701-49b5-b32d-f28ac613b794'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:28 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:28 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:28 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:28 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-24dbd48e-8ece-40b9-8fb7-be1b52a5bd7c tempest-GroupSnapshotsV319Test-1295295431 None] Delete group completed successfully. Jul 23 03:21:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Acquiring lock "cinder-quobyte-e25454df-c6d5-4075-b5f8-56a299e410e1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-e25454df-c6d5-4075-b5f8-56a299e410e1" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9817be-87bc-46f6-8050-7b8d00aeab7e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:30 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 Jul 23 03:21:30 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:30 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1" returned: 0 in 0.437s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:30 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1 Jul 23 03:21:30 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:30 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e25454df-c6d5-4075-b5f8-56a299e410e1" returned: 0 in 0.318s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-e25454df-c6d5-4075-b5f8-56a299e410e1" released by "delete_volume" :: held 0.812s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Created reservations ['a4671f63-522c-4f2c-a511-b4a073d291e1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:30 devstack cinder-volume[88466]: WARNING cinder.quota [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1227949900 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1227949900, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:30 devstack cinder-volume[88466]: WARNING cinder.quota [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1227949900 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1227949900, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:30 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Created reservations ['7bdbd39f-f084-460e-a80f-37b058f813be', '1f63e08b-5ca3-4669-a105-0062920d085c', '646e4c35-2ce2-45ce-970e-f33b94d6a8ce', 'e5fc9dce-d1ab-4b2f-b981-a7cd03fe4080'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:31 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:31 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:31 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Created reservations ['1486163a-9993-46f1-b3f3-9672bfe4141a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.341s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6521d456-23ad-4fc6-83e4-315c5af98faf tempest-GroupsTest-940684746 None] Delete group completed successfully. Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:31 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:31 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:31 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.334s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:31 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f53d3039-898e-41b9-9d79-40a6d99b8ba7 tempest-GroupsTest-940684746 None] Delete group completed successfully. Jul 23 03:21:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46e8d327-2541-4731-aafd-bb4398f298d9 tempest-GroupsTest-940684746 None] Group tempest-GroupsTest-Group-161808529: creating Jul 23 03:21:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46e8d327-2541-4731-aafd-bb4398f298d9 tempest-GroupsTest-940684746 None] Group tempest-GroupsTest-Group-161808529: created successfully Jul 23 03:21:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46e8d327-2541-4731-aafd-bb4398f298d9 tempest-GroupsTest-940684746 None] Create group completed successfully. Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (df1e5fc0-5609-4fd4-8859-63d7ef2f3b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454987ec-76f3-4cb6-8f3f-3ed267d26d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454987ec-76f3-4cb6-8f3f-3ed267d26d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557179843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0873c818-035e-4555-a4a5-68fce92479a5,host='devstack@QuobyteHD#QuobyteHD',id=d5c5a45d-a28d-4807-9493-9eaaabe4a1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:35Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(010723a5-27de-4f9c-83ab-0c6edf8838a1),volume_type_id=010723a5-27de-4f9c-83ab-0c6edf8838a1)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6679869-dee2-4c61-917c-01be210da609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6679869-dee2-4c61-917c-01be210da609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685f0240-3ed9-4193-8326-fb76c0e53402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685f0240-3ed9-4193-8326-fb76c0e53402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c5a45d-a28d-4807-9493-9eaaabe4a1a4', 'volume_name': 'volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21cf5ba-a47c-4587-ad24-fa057121c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21cf5ba-a47c-4587-ad24-fa057121c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc2e375-996e-4255-b0e6-076aecd0c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:35 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Volume d5c5a45d-a28d-4807-9493-9eaaabe4a1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4', 'volume_size': 1} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0873c818-035e-4555-a4a5-68fce92479a5,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557179843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0873c818-035e-4555-a4a5-68fce92479a5,host='devstack@QuobyteHD#QuobyteHD',id=d5c5a45d-a28d-4807-9493-9eaaabe4a1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:35Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(010723a5-27de-4f9c-83ab-0c6edf8838a1),volume_type_id=010723a5-27de-4f9c-83ab-0c6edf8838a1)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Creating volume d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:35 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:35 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 1073741824 Jul 23 03:21:35 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9228806e-34ba-4b9e-b090-2a14bce8721f tempest-GroupsV314Test-669333647 None] Group tempest-GroupsV314Test-Group-592898346: creating Jul 23 03:21:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9228806e-34ba-4b9e-b090-2a14bce8721f tempest-GroupsV314Test-669333647 None] Group tempest-GroupsV314Test-Group-592898346: created successfully Jul 23 03:21:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9228806e-34ba-4b9e-b090-2a14bce8721f tempest-GroupsV314Test-669333647 None] Create group completed successfully. Jul 23 03:21:35 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 1073741824" returned: 0 in 0.712s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:35 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 Jul 23 03:21:35 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:36 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc2e375-996e-4255-b0e6-076aecd0c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c935f88d-5c47-4dfb-b0a3-1494ccff9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Volume volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 (d5c5a45d-a28d-4807-9493-9eaaabe4a1a4): created successfully Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c935f88d-5c47-4dfb-b0a3-1494ccff9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (df1e5fc0-5609-4fd4-8859-63d7ef2f3b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cb0eede1-5203-4084-a523-2f64f32c6770 tempest-GroupsTest-940684746 None] Created volume successfully. Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Flow 'volume_create_manager' (598b46f6-cd6e-47f7-8f80-b76cba1c5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909270d1-3c17-4030-9dcb-92e9353ab63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909270d1-3c17-4030-9dcb-92e9353ab63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117782304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdc93d33-012b-4216-927d-57e08b6cdb6e,host='devstack@QuobyteHD#QuobyteHD',id=54ade001-c721-4dc6-9f5e-2c4d43f46fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ff46d649e74942840c447111c7df83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:37Z,use_quota=True,user_id='a57b8506c4544cf29d9d4f08f3cbffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df39fd6e-c234-4acf-8885-a441999d2bbc),volume_type_id=df39fd6e-c234-4acf-8885-a441999d2bbc)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4c509-8246-497b-9d47-fc66c07d6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4c509-8246-497b-9d47-fc66c07d6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2bbea3-de46-4767-bb59-8f3d8ae3d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2bbea3-de46-4767-bb59-8f3d8ae3d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ade001-c721-4dc6-9f5e-2c4d43f46fa9', 'volume_name': 'volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d807e4-07ed-4ced-8533-a2da1dd6a5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d807e4-07ed-4ced-8533-a2da1dd6a5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344bc473-e5fd-4d7b-a94f-a2c12ee2d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Volume 54ade001-c721-4dc6-9f5e-2c4d43f46fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9', 'volume_size': 1} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdc93d33-012b-4216-927d-57e08b6cdb6e,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117782304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdc93d33-012b-4216-927d-57e08b6cdb6e,host='devstack@QuobyteHD#QuobyteHD',id=54ade001-c721-4dc6-9f5e-2c4d43f46fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ff46d649e74942840c447111c7df83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:37Z,use_quota=True,user_id='a57b8506c4544cf29d9d4f08f3cbffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df39fd6e-c234-4acf-8885-a441999d2bbc),volume_type_id=df39fd6e-c234-4acf-8885-a441999d2bbc)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Creating volume 54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:37 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:37 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 1073741824 Jul 23 03:21:37 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:38 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 1073741824" returned: 0 in 0.767s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:38 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:38 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (265c4015-e63a-425f-ab3a-a150932ea37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f99609a-6302-4026-bdd3-708aa784e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f99609a-6302-4026-bdd3-708aa784e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387979588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0873c818-035e-4555-a4a5-68fce92479a5,host='devstack@QuobyteHD#QuobyteHD',id=341f4b4e-b8af-46d4-b029-e913e4144f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:38Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(010723a5-27de-4f9c-83ab-0c6edf8838a1),volume_type_id=010723a5-27de-4f9c-83ab-0c6edf8838a1)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c34f9d-840e-47f4-8895-f00d2e44a920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c34f9d-840e-47f4-8895-f00d2e44a920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9bbfd8-56de-4c33-ac62-d647cabd3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9bbfd8-56de-4c33-ac62-d647cabd3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341f4b4e-b8af-46d4-b029-e913e4144f5e', 'volume_name': 'volume-341f4b4e-b8af-46d4-b029-e913e4144f5e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57f1025-81ff-4c64-924e-7ae2fbc3c431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57f1025-81ff-4c64-924e-7ae2fbc3c431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c1cb63-90e8-42dd-bdf1-1d3154a458ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Volume 341f4b4e-b8af-46d4-b029-e913e4144f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341f4b4e-b8af-46d4-b029-e913e4144f5e', 'volume_size': 1} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:38 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.439s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.200s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0873c818-035e-4555-a4a5-68fce92479a5,created_at=2026-07-23T01:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387979588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0873c818-035e-4555-a4a5-68fce92479a5,host='devstack@QuobyteHD#QuobyteHD',id=341f4b4e-b8af-46d4-b029-e913e4144f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc51133ebd914125b98269991a08e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:38Z,use_quota=True,user_id='6eeea06f85af4b6689d8b83a9ee57a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(010723a5-27de-4f9c-83ab-0c6edf8838a1),volume_type_id=010723a5-27de-4f9c-83ab-0c6edf8838a1)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Creating volume 341f4b4e-b8af-46d4-b029-e913e4144f5e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:38 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:38 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e 1073741824 Jul 23 03:21:38 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344bc473-e5fd-4d7b-a94f-a2c12ee2d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e77e6b-5d9f-4e57-a59c-999c70a963ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Volume volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 (54ade001-c721-4dc6-9f5e-2c4d43f46fa9): created successfully Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e77e6b-5d9f-4e57-a59c-999c70a963ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Flow 'volume_create_manager' (598b46f6-cd6e-47f7-8f80-b76cba1c5851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a3d8dc78-f8fd-4973-8484-1e9532139465 tempest-GroupsV314Test-669333647 None] Created volume successfully. Jul 23 03:21:39 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e 1073741824" returned: 0 in 0.595s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:39 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e Jul 23 03:21:39 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:40 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e" returned: 0 in 0.696s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c1cb63-90e8-42dd-bdf1-1d3154a458ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341f4b4e-b8af-46d4-b029-e913e4144f5e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff2a2b4-158a-4ce3-8091-ce799fd7f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:40 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Volume volume-341f4b4e-b8af-46d4-b029-e913e4144f5e (341f4b4e-b8af-46d4-b029-e913e4144f5e): created successfully Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff2a2b4-158a-4ce3-8091-ce799fd7f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Flow 'volume_create_manager' (265c4015-e63a-425f-ab3a-a150932ea37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:40 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fcc052bb-b2a5-43f7-918b-e546403b2892 tempest-GroupsTest-940684746 None] Created volume successfully. Jul 23 03:21:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f61c5a02-063e-472f-93ba-90210433b37d tempest-GroupsTest-940684746 None] Update group completed successfully. Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:41 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Cloning volume 54ade001-c721-4dc6-9f5e-2c4d43f46fa9 to volume 375bc4f7-e091-411c-a706-f8b88123a388 Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Creating offline snapshot 8dee854c-760b-48ed-899e-28a00bdba242 of volume 54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[44059a56-c4ea-45a5-bb64-a668bafa7326]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:41 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:41 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:41 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.535s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:41 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 1G Jul 23 03:21:41 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:42 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 1G" returned: 0 in 0.629s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:42 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:42 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-854288f6-eb1e-4a98-a4a8-27079fa9d965 tempest-GroupsTest-940684746 None] Update group completed successfully. Jul 23 03:21:42 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:42 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:43 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:43 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:43 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:43 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info Jul 23 03:21:43 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:43 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info" returned: 0 in 0.238s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:43 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:43 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info Jul 23 03:21:43 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:43 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.info" returned: 0 in 0.234s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Acquiring lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] snapshot: 8dee854c-760b-48ed-899e-28a00bdba242, volume: 375bc4f7-e091-411c-a706-f8b88123a388, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d8dfef-a5ca-4a7a-8b8e-489a6a0a022b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:44 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Acquiring lock "cinder-quobyte-341f4b4e-b8af-46d4-b029-e913e4144f5e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-341f4b4e-b8af-46d4-b029-e913e4144f5e" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:44 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf79ca3e-653a-455d-bab8-2e8987b12f83]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2440891-18fe-4994-b072-1fcd028ff38f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e Jul 23 03:21:44 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:44 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e" returned: 0 in 0.457s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.455s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:21:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e Jul 23 03:21:44 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 Jul 23 03:21:44 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:45 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-341f4b4e-b8af-46d4-b029-e913e4144f5e" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-341f4b4e-b8af-46d4-b029-e913e4144f5e" released by "delete_volume" :: held 0.856s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Acquiring lock "cinder-quobyte-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b894f621-518b-4e6c-92c0-6d5453206cf4]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:45 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 Jul 23 03:21:45 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Acquiring lock "cinder-9b06aca5-60dd-45c4-b138-73d13dfa64cf-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "cinder-9b06aca5-60dd-45c4-b138-73d13dfa64cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Acquiring lock "cinder-quobyte-9b06aca5-60dd-45c4-b138-73d13dfa64cf" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "cinder-quobyte-9b06aca5-60dd-45c4-b138-73d13dfa64cf" acquired by "delete_volume" :: waited 0.056s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc1a3c5-65ef-4c84-a79c-84ccbda95bbd]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:46 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf Jul 23 03:21:46 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:46 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" returned: 0 in 0.898s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:46 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4 Jul 23 03:21:46 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:46 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf" returned: 0 in 1.065s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:46 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" returned: 0 in 0.747s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:46 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf Jul 23 03:21:46 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "cinder-quobyte-d5c5a45d-a28d-4807-9493-9eaaabe4a1a4" released by "delete_volume" :: held 1.739s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Created reservations ['b16a4c0d-ac31-4479-9114-4dfbce16cdef'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:47 devstack cinder-volume[88466]: WARNING cinder.quota [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1516766784 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1516766784, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:47 devstack cinder-volume[88466]: WARNING cinder.quota [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1516766784 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1516766784, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Created reservations ['d4270c2b-d6d2-48dd-9d0d-0b9be2c8be47', '4802d4e5-d2b2-4a54-b02c-2a09946f6f28', '4646bc1c-b0e4-43a6-a5b3-6602bc9d5e8f', 'e7733c54-ba0a-41d4-8d60-9c884e68111e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:47 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9b06aca5-60dd-45c4-b138-73d13dfa64cf" returned: 0 in 0.738s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "cinder-quobyte-9b06aca5-60dd-45c4-b138-73d13dfa64cf" released by "delete_volume" :: held 1.935s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Created reservations ['23b65c0a-0dd7-4c36-b0e3-7aa017468966', '2e2bb237-f897-4708-a81f-49f27a15e74c', '63f6bafa-4663-49fd-acab-a39299ddb40c', '53009a0d-94fc-4ef7-ada4-2bb2a691a06a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:47 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:47 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Created reservations ['4da60492-aa6e-4da4-b365-5fea3d8049c1', '8a97d4bc-fe57-4e80-b621-15e11d3be115', 'b9b5c9b6-980c-4f54-9375-5850b1be3bb7', '475b7091-c330-43d5-9737-c0b698f599d8'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:48 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:48 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:48 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.639s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 8 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:48 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.366s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:48 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:48 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Deleted volume successfully. Jul 23 03:21:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36559f7c-5729-4b8f-97ab-f83e0f1e896a tempest-AttachVolumeShelveTestJSON-1841244794 None] Lock "cinder-9b06aca5-60dd-45c4-b138-73d13dfa64cf-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:49 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:49 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b9446489-5466-4c06-a41c-0845667fe3b4 tempest-GroupsTest-940684746 None] Delete group completed successfully. Jul 23 03:21:51 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388" returned: 0 in 6.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd591c1-5a7a-436d-8a87-eba8d43c6595]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:51 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:51 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:52 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.756s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:21:52 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Converted 1024.00 MB image at 157.63 MB/s Jul 23 03:21:52 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:52 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 Jul 23 03:21:52 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:52 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" released by "_copy_volume_from_snapshot" :: held 8.704s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=137,cinder:INSERT=28,cinder:UPDATE=160,cinder:DELETE=6 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Acquiring lock "cinder-quobyte-8dee854c-760b-48ed-899e-28a00bdba242" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-8dee854c-760b-48ed-899e-28a00bdba242" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Deleting offline snapshot 8dee854c-760b-48ed-899e-28a00bdba242 of volume 54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] snapshot_file for this snap is: volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bc54b-bb75-492f-be40-6a3ddfce16cb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:52 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:52 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:53 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.485s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3e4bd-49bc-401d-a9a1-7fc6cc2ecfcd]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:53 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:53 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:53 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.448s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:53 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:53 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:54 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:54 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242 Jul 23 03:21:54 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:54 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9.8dee854c-760b-48ed-899e-28a00bdba242" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-8dee854c-760b-48ed-899e-28a00bdba242" released by "_delete_snapshot" :: held 1.837s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=143,cinder:UPDATE=143,cinder:INSERT=41,cinder:DELETE=5 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:21:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.235s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d0a3fbc0-3b6f-437b-abb0-24eca2c7fd51 tempest-GroupsV314Test-669333647 None] Create group from source-group-cdc93d33-012b-4216-927d-57e08b6cdb6e completed successfully. Jul 23 03:21:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Acquiring lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[39302691-713a-4326-88a7-443c67271950]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:55 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 Jul 23 03:21:55 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:56 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388" returned: 0 in 0.462s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:56 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388 Jul 23 03:21:56 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:56 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-375bc4f7-e091-411c-a706-f8b88123a388" returned: 0 in 0.292s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-375bc4f7-e091-411c-a706-f8b88123a388" released by "delete_volume" :: held 0.811s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Created reservations ['ce5e03f0-b6df-40d5-b292-36f3f7597844'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:56 devstack cinder-volume[88466]: WARNING cinder.quota [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2120757568 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2120757568, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:56 devstack cinder-volume[88466]: WARNING cinder.quota [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2120757568 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2120757568, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Created reservations ['91e0c958-8d3e-424a-b73b-4ce488564603', '1448289e-3206-454c-a0dd-5d40f3e837af', 'c2ec47fa-aa05-4631-887a-b762fd205234', '4759da56-24ce-4859-b6e1-4a34d61ebde8'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:56 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:56 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:57 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.326s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-255a28af-85ea-4e28-b62d-0682d2c3ccdf tempest-GroupsV314Test-669333647 None] Delete group completed successfully. Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Acquiring lock "cinder-quobyte-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-04aeee50-2534-40f2-a338-40a2be133030 tempest-GroupsV320Test-434901751 None] Group tempest-GroupsV320Test-Group-1631613147: creating Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[07718ca6-0de1-4000-b31e-7b4c604be9d2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-04aeee50-2534-40f2-a338-40a2be133030 tempest-GroupsV320Test-434901751 None] Group tempest-GroupsV320Test-Group-1631613147: created successfully Jul 23 03:21:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-04aeee50-2534-40f2-a338-40a2be133030 tempest-GroupsV320Test-434901751 None] Create group completed successfully. Jul 23 03:21:57 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:57 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:57 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9 Jul 23 03:21:57 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:58 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Lock "cinder-quobyte-54ade001-c721-4dc6-9f5e-2c4d43f46fa9" released by "delete_volume" :: held 0.768s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Created reservations ['46ed150e-0c3d-49bd-b611-63d6d0e9574b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Created reservations ['0a9ebd9b-ecf1-4a4e-a770-1c0588d5ac07', '92c6d08a-db10-4a64-a457-766141af88c3', '1ed92dad-be57-435e-8462-e5812283f700', '5bff19f9-4183-4d30-85ae-8417486ab97a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:58 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:58 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:58 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.449s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:58 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fbfece08-c9c2-445c-bf2b-cc43348899eb tempest-GroupsV314Test-669333647 None] Delete group completed successfully. Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Created reservations ['e6dacc93-fd53-4ba3-b615-89ea14103038'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:59 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:21:59 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:59 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.290s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:59 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-54ab00f3-5629-4776-8c6b-a73181f41d75 tempest-GroupsV320Test-434901751 None] Delete group completed successfully. Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Flow 'volume_create_manager' (02c469cd-aba8-4a43-8618-24acef4bb7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb766b38-e3c5-4a0a-b9bb-f8f86cee6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb766b38-e3c5-4a0a-b9bb-f8f86cee6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-643485413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf904f2-124d-4d97-be8e-f0321b5750c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b8113579a647988696cff6a2e1bf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:08Z,use_quota=True,user_id='30509f53689842fc9e7959bc158240f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f8879-2744-4fd0-83b3-26be36dc67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f8879-2744-4fd0-83b3-26be36dc67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14567fff-1928-415c-846d-9048a7410bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14567fff-1928-415c-846d-9048a7410bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf904f2-124d-4d97-be8e-f0321b5750c7', 'volume_name': 'volume-7bf904f2-124d-4d97-be8e-f0321b5750c7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c0de43-ea3e-4d52-93d4-74c9f97db1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c0de43-ea3e-4d52-93d4-74c9f97db1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdbee5d-25e4-4e3f-8dc6-034f2a75a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Volume 7bf904f2-124d-4d97-be8e-f0321b5750c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf904f2-124d-4d97-be8e-f0321b5750c7', 'volume_size': 1} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-643485413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf904f2-124d-4d97-be8e-f0321b5750c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b8113579a647988696cff6a2e1bf32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:08Z,use_quota=True,user_id='30509f53689842fc9e7959bc158240f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Creating volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:08 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:08 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 1073741824 Jul 23 03:22:08 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:08 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 1073741824" returned: 0 in 0.635s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:09 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 Jul 23 03:22:09 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:09 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdbee5d-25e4-4e3f-8dc6-034f2a75a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf904f2-124d-4d97-be8e-f0321b5750c7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae2aed8-e548-4578-bb7e-9e21c4b83b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Volume volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 (7bf904f2-124d-4d97-be8e-f0321b5750c7): created successfully Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae2aed8-e548-4578-bb7e-9e21c4b83b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Flow 'volume_create_manager' (02c469cd-aba8-4a43-8618-24acef4bb7b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:09 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7597bfa6-9d04-44ac-9c28-358e5a81758a tempest-SnapshotsActionsTest-425046865 None] Created volume successfully. Jul 23 03:22:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-70b391af-c2ac-4d21-89a0-93ba2e979729 req-e4468f0f-c462-4c81-ad69-fcca5937eb72 tempest-AttachVolumeNegativeTest-2811165 None] Terminate volume connection completed successfully. Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-70b391af-c2ac-4d21-89a0-93ba2e979729 req-e4468f0f-c462-4c81-ad69-fcca5937eb72 tempest-AttachVolumeNegativeTest-2811165 None] Deleting attachment 4d82f803-8e21-4e40-9066-18f2cfa1e7af. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Creating offline snapshot 30ab7053-52c5-455f-992b-6bb1b09d541e of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b39628d-fd79-481d-9c89-934618d78a97]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:10 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 Jul 23 03:22:10 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:10 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7" returned: 0 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:10 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e 1G Jul 23 03:22:10 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Flow 'volume_create_manager' (d2fbfb29-ccfa-450b-b7c7-d5a1a16d3598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:11 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5bb06-d592-44a7-99e2-1d2c4e9aca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e 1G" returned: 0 in 0.734s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:11 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:11 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5bb06-d592-44a7-99e2-1d2c4e9aca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-377515588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ccd61-eb32-412a-94b5-8f563917451e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a321482d21dc42aeb470e5451d222d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:11Z,use_quota=True,user_id='94a08284e95448ed9e84c8870b300aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13acb2-da04-4647-853a-8918d55bbec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13acb2-da04-4647-853a-8918d55bbec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738cf213-6e30-49db-92f4-bc081ab720c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738cf213-6e30-49db-92f4-bc081ab720c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287ccd61-eb32-412a-94b5-8f563917451e', 'volume_name': 'volume-287ccd61-eb32-412a-94b5-8f563917451e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177e7752-f381-44b6-9424-2ff7f5f11ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177e7752-f381-44b6-9424-2ff7f5f11ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ecfe2a-22a2-4a84-ad9d-b152981e6566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Volume 287ccd61-eb32-412a-94b5-8f563917451e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287ccd61-eb32-412a-94b5-8f563917451e', 'volume_size': 1} Jul 23 03:22:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:12 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.466s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e is being set with open permissions: ugo+rw Jul 23 03:22:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:12 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:12 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:12 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:12 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info Jul 23 03:22:12 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:13 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info" returned: 0 in 0.388s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:13 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info is being set with open permissions: ugo+rw Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:13 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info Jul 23 03:22:13 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:13 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.info" returned: 0 in 0.477s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-377515588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ccd61-eb32-412a-94b5-8f563917451e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a321482d21dc42aeb470e5451d222d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:11Z,use_quota=True,user_id='94a08284e95448ed9e84c8870b300aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Creating volume 287ccd61-eb32-412a-94b5-8f563917451e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:13 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:13 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e 1073741824 Jul 23 03:22:13 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3dc423dd-11dc-41d4-a8a5-d972d2989e9e tempest-SnapshotsActionsTest-425046865 None] Create snapshot completed successfully Jul 23 03:22:14 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e 1073741824" returned: 0 in 0.551s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:14 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e Jul 23 03:22:14 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:14 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e" returned: 0 in 0.263s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ecfe2a-22a2-4a84-ad9d-b152981e6566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287ccd61-eb32-412a-94b5-8f563917451e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a68902-52ac-402c-92af-72eee51edb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Volume volume-287ccd61-eb32-412a-94b5-8f563917451e (287ccd61-eb32-412a-94b5-8f563917451e): created successfully Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a68902-52ac-402c-92af-72eee51edb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Flow 'volume_create_manager' (d2fbfb29-ccfa-450b-b7c7-d5a1a16d3598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8b3ba9f7-517e-42b1-b346-5976d047f0a5 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Created volume successfully. Jul 23 03:22:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Creating offline snapshot f2975528-dc8f-4e74-a559-36c6d3c9607d of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:22:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb692997-7fbe-41a9-843a-003339533ba9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:15 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:15 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Acquiring lock "cinder-287ccd61-eb32-412a-94b5-8f563917451e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "cinder-287ccd61-eb32-412a-94b5-8f563917451e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Acquiring lock "cinder-quobyte-287ccd61-eb32-412a-94b5-8f563917451e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "cinder-quobyte-287ccd61-eb32-412a-94b5-8f563917451e" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[926279d8-f609-42d8-ac10-9e2038d2dd4c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:16 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.586s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:16 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d 1G Jul 23 03:22:16 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:16 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e Jul 23 03:22:16 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:16 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e" returned: 0 in 0.462s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:16 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e Jul 23 03:22:16 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:16 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d 1G" returned: 0 in 0.627s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:17 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d Jul 23 03:22:17 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:17 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-287ccd61-eb32-412a-94b5-8f563917451e" returned: 0 in 0.365s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "cinder-quobyte-287ccd61-eb32-412a-94b5-8f563917451e" released by "delete_volume" :: held 0.887s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Created reservations ['f7f9afa1-b01c-4273-8fda-5abba43bfdb8', 'c23c5a61-19f0-4b7a-b98f-8d1a830602d6', '5558cc7c-726b-4b94-a0f0-656e81c567d5', 'ae283fb8-225a-4494-821b-b1a9ee9a414c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:17 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:17 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:17 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d" returned: 0 in 0.456s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:17 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d is being set with open permissions: ugo+rw Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:17 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d Jul 23 03:22:17 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:17 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.403s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Deleted volume successfully. Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7b0fdb5d-6a4e-4697-86be-6a0aac416d73 tempest-VolumeQuotasNegativeTestJSON-2086204916 None] Lock "cinder-287ccd61-eb32-412a-94b5-8f563917451e-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:17 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d" returned: 0 in 0.432s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a81f9d3a-93f7-48e2-bb8c-5e9895454c8c tempest-SnapshotsActionsTest-425046865 None] Create snapshot completed successfully Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-f2975528-dc8f-4e74-a559-36c6d3c9607d-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-f2975528-dc8f-4e74-a559-36c6d3c9607d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-f2975528-dc8f-4e74-a559-36c6d3c9607d" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-f2975528-dc8f-4e74-a559-36c6d3c9607d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Deleting offline snapshot f2975528-dc8f-4e74-a559-36c6d3c9607d of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] snapshot_file for this snap is: volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7815c-51a9-40e6-9585-9fd5bee6916c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:19 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d Jul 23 03:22:19 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:19 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d" returned: 0 in 0.458s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3944b-3513-42e6-b5db-00a5c37a4f36]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:19 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:19 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:20 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.560s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:20 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d Jul 23 03:22:20 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:21 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d" returned: 0 in 0.783s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:21 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d Jul 23 03:22:21 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:21 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f2975528-dc8f-4e74-a559-36c6d3c9607d" returned: 0 in 0.382s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-f2975528-dc8f-4e74-a559-36c6d3c9607d" released by "_delete_snapshot" :: held 2.396s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_snapshot" :: held 2.437s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:21 devstack cinder-volume[88466]: WARNING cinder.quota [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Created reservations ['651c9340-6298-45ed-a4c9-de4c263d0fe2', '12761fa9-ece3-49b4-a9f7-0dfb40088f71', 'b273a5ea-0d6e-4a39-a236-6a10fa774239', '83ae0e79-a9c6-4b36-91f1-4a1c9210bc6c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:21 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Delete snapshot completed successfully. Jul 23 03:22:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7360a1b9-1ee6-4fe4-8127-6f9d1f15f07e tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-f2975528-dc8f-4e74-a559-36c6d3c9607d-delete_snapshot" released by "delete_snapshot" :: held 2.742s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Creating offline snapshot f84388e1-4f2f-4d39-8d01-5fdc71f2b89b of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:22:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3e759-8675-4abd-9e7b-0c14717217bb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:23 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:23 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:23 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.498s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:23 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b 1G Jul 23 03:22:23 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:24 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b 1G" returned: 0 in 0.690s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:24 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b Jul 23 03:22:24 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:24 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:24 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b is being set with open permissions: ugo+rw Jul 23 03:22:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:24 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b Jul 23 03:22:24 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:24 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" returned: 0 in 0.393s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6ac4fda2-661d-4872-9381-9558f3968999 tempest-SnapshotsActionsTest-425046865 None] Create snapshot completed successfully Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Deleting offline snapshot f84388e1-4f2f-4d39-8d01-5fdc71f2b89b of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] snapshot_file for this snap is: volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[05988463-83d9-48e3-a3f4-17f0bbd7e5ab]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:27 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b Jul 23 03:22:27 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:27 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" returned: 0 in 0.747s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e9d95-321d-4016-a353-7c9b6d876f3b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:27 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:27 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:28 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.572s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:28 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b Jul 23 03:22:28 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:28 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" returned: 0 in 0.822s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b Jul 23 03:22:29 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" returned: 0 in 0.308s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b" released by "_delete_snapshot" :: held 2.680s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_snapshot" :: held 2.788s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:29 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Created reservations ['81c93000-5f50-4eb4-bfae-194d4df60149', 'f101ce9f-eb75-4767-b3dc-8a3738a608d2', '12b32f5b-0019-4623-8568-92f6a3716365', '11a8e938-eff7-4c0a-a9b4-013e95c9aed8'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Delete snapshot completed successfully. Jul 23 03:22:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d20b49c3-a5dc-468b-8d47-7af57ea79021 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-f84388e1-4f2f-4d39-8d01-5fdc71f2b89b-delete_snapshot" released by "delete_snapshot" :: held 3.043s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Creating offline snapshot 190b4736-bd06-4324-b494-806c5a934786 of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:22:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a060e-8c60-4a28-bcca-7ee140dce3e7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:31 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:31 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Flow 'volume_create_manager' (1a4d06b6-bc2f-4dad-9745-a0ff565ce358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a14db2-6b00-483c-9533-d67cced60bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a14db2-6b00-483c-9533-d67cced60bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1784677652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a4094-515a-437f-972e-988c9eae2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe30a8badd014b1fbdedb89c9c0cfd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:31Z,use_quota=True,user_id='ed057f95108646f29f51c77c7d166be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee31cc8-30eb-40ff-b020-7308d3b10928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:31 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee31cc8-30eb-40ff-b020-7308d3b10928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2bb41e-9532-4070-939b-65b86aa19de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.698s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:31 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 1G Jul 23 03:22:31 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2bb41e-9532-4070-939b-65b86aa19de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a79a4094-515a-437f-972e-988c9eae2fc1', 'volume_name': 'volume-a79a4094-515a-437f-972e-988c9eae2fc1', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d554b3-d18f-4275-b87c-22db51849e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d554b3-d18f-4275-b87c-22db51849e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3996da-6a45-4ee9-9669-b8533f12ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Volume a79a4094-515a-437f-972e-988c9eae2fc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a79a4094-515a-437f-972e-988c9eae2fc1', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Trying to clone a79a4094-515a-437f-972e-988c9eae2fc1 from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:22:32 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 1G" returned: 0 in 0.657s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:32 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 Jul 23 03:22:32 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:22:32 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c673dca-f7cc-4774-8a13-0d72ba620bcc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:32 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786" returned: 0 in 0.814s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:32 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 is being set with open permissions: ugo+rw Jul 23 03:22:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:33 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 Jul 23 03:22:33 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD Jul 23 03:22:33 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786" returned: 0 in 0.526s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:33 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 is fetched for user ed057f95108646f29f51c77c7d166be3. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:22:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fd679cfd-be30-4122-b7f3-ab3c78285b38 tempest-SnapshotsActionsTest-425046865 None] Create snapshot completed successfully Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a135e9-cad7-43d6-a773-d00712a5b206]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:33 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD Jul 23 03:22:33 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:34 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1784677652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79a4094-515a-437f-972e-988c9eae2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe30a8badd014b1fbdedb89c9c0cfd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:31Z,use_quota=True,user_id='ed057f95108646f29f51c77c7d166be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Creating volume a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:34 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:34 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1073741824 Jul 23 03:22:34 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-190b4736-bd06-4324-b494-806c5a934786-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-190b4736-bd06-4324-b494-806c5a934786-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-190b4736-bd06-4324-b494-806c5a934786" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-190b4736-bd06-4324-b494-806c5a934786" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Deleting offline snapshot 190b4736-bd06-4324-b494-806c5a934786 of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:35 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] snapshot_file for this snap is: volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1073741824" returned: 0 in 0.981s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e86be5c-ff57-4cd7-99ed-4364a9ae980c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:35 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 Jul 23 03:22:35 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:35 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 Jul 23 03:22:35 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1" returned: 0 in 0.513s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Attempting download of ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume a79a4094-515a-437f-972e-988c9eae2fc1. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd4cba-682e-4bd0-8da2-4767c0f763dc]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786" returned: 0 in 0.785s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6948af2c-8d03-4965-9d92-12f93ad6fe5b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:36 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju Jul 23 03:22:36 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju" returned: 0 in 0.570s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.517s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 Jul 23 03:22:36 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju Jul 23 03:22:36 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju" returned: 1 in 0.434s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_0rx8adju' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac962ee-c2d9-4b2f-ad5f-53897e0ee097]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:37 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD Jul 23 03:22:37 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786" returned: 0 in 0.528s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:37 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786 Jul 23 03:22:37 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] ab7985a2-acac-4f9a-9e57-b9a25e5021d5 was qcow2, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:37 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 Jul 23 03:22:37 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.190b4736-bd06-4324-b494-806c5a934786" returned: 0 in 0.321s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-190b4736-bd06-4324-b494-806c5a934786" released by "_delete_snapshot" :: held 2.310s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_snapshot" :: held 2.364s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Created reservations ['52c03631-45be-427f-ae00-9c3786bf6672', '289e2337-d6d7-4ae0-8464-daedd09027ad', '55652a78-5fca-4a04-b746-917896e5f399', '84d4a45a-9212-49ea-86b4-11407953d5fe'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:37 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Delete snapshot completed successfully. Jul 23 03:22:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-86c5e7d5-18b9-4e23-92ef-797497745b39 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-190b4736-bd06-4324-b494-806c5a934786-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Creating offline snapshot 85984ab0-062e-4de4-9892-75a29231c480 of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a509889-6e7b-4c2f-9d6f-8ea96687d9b5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:39 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1" returned: 0 in 2.047s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_oh33n7yldevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:22:39 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Converted 112.00 MB image at 54.65 MB/s Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1G Jul 23 03:22:39 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.526s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 1G Jul 23 03:22:39 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 1G" returned: 0 in 0.344s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Downloaded image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume a79a4094-515a-437f-972e-988c9eae2fc1 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 for user ed057f95108646f29f51c77c7d166be3 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:22:39 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Marking volume a79a4094-515a-437f-972e-988c9eae2fc1 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Copying metadata from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 to a79a4094-515a-437f-972e-988c9eae2fc1. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Creating volume glance metadata for volume a79a4094-515a-437f-972e-988c9eae2fc1 backed by image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3996da-6a45-4ee9-9669-b8533f12ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79a4094-515a-437f-972e-988c9eae2fc1', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c16846-a2ef-4216-a892-75521fc6ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:40 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Volume volume-a79a4094-515a-437f-972e-988c9eae2fc1 (a79a4094-515a-437f-972e-988c9eae2fc1): created successfully Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c16846-a2ef-4216-a892-75521fc6ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Flow 'volume_create_manager' (1a4d06b6-bc2f-4dad-9745-a0ff565ce358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:40 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bc21425c-d5eb-4b40-9468-e837db49581e tempest-VolumesImageMetadata-761586769 None] Created volume successfully. Jul 23 03:22:40 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 1G" returned: 0 in 0.657s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:40 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 Jul 23 03:22:40 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:40 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480" returned: 0 in 0.398s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 is being set with open permissions: ugo+rw Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:40 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 Jul 23 03:22:40 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Acquiring lock "cinder-a79a4094-515a-437f-972e-988c9eae2fc1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "cinder-a79a4094-515a-437f-972e-988c9eae2fc1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Acquiring lock "cinder-quobyte-a79a4094-515a-437f-972e-988c9eae2fc1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "cinder-quobyte-a79a4094-515a-437f-972e-988c9eae2fc1" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[45390b66-e0f6-4ccc-bb85-875473595e8a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:41 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5fa1015f-87c3-45f6-be3a-f08c125f12b7 tempest-SnapshotsActionsTest-425046865 None] Create snapshot completed successfully Jul 23 03:22:41 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 Jul 23 03:22:41 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:41 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1" returned: 0 in 0.451s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:41 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1 Jul 23 03:22:41 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:41 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a79a4094-515a-437f-972e-988c9eae2fc1" returned: 0 in 0.248s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "cinder-quobyte-a79a4094-515a-437f-972e-988c9eae2fc1" released by "delete_volume" :: held 0.749s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Created reservations ['24c4f6f9-01e6-4733-b2e0-12dbd6aba1b9', '82f03c21-cca3-4d17-b159-3e78eea1ed81', '509db228-fdf8-4651-b690-825f869bc5eb', 'b48281c0-ecba-4717-bd90-747c4f193c97'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:41 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:41 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:42 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Deleted volume successfully. Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7bce8e49-50f2-4203-977b-3d615db1e277 tempest-VolumesImageMetadata-761586769 None] Lock "cinder-a79a4094-515a-437f-972e-988c9eae2fc1-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-85984ab0-062e-4de4-9892-75a29231c480-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-85984ab0-062e-4de4-9892-75a29231c480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Acquiring lock "cinder-quobyte-85984ab0-062e-4de4-9892-75a29231c480" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-85984ab0-062e-4de4-9892-75a29231c480" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Deleting offline snapshot 85984ab0-062e-4de4-9892-75a29231c480 of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] snapshot_file for this snap is: volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f14f0cc-b04f-4458-9413-23a49e273aed]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:42 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 Jul 23 03:22:42 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:42 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fe8705-e956-4ed3-a8a3-b13430bb7098]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:43 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.501s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 Jul 23 03:22:43 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480" returned: 0 in 0.577s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:44 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480 Jul 23 03:22:44 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.85984ab0-062e-4de4-9892-75a29231c480" returned: 0 in 0.308s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-85984ab0-062e-4de4-9892-75a29231c480" released by "_delete_snapshot" :: held 2.001s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_snapshot" :: held 2.033s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Created reservations ['0ef2b6a5-fd30-4b64-8ed4-3540e312cc6b', '549098ee-c887-4f23-a4a8-ab5b0b994f2a', 'ebdbca7b-2307-4350-b8be-e15d7d2c9e66', '23d1fdc7-b189-45d5-bd90-88fafb4390cc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Delete snapshot completed successfully. Jul 23 03:22:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eb598bf-dc7b-4d6c-aef1-105522976d98 tempest-SnapshotsActionsTest-589646433 None] Lock "cinder-85984ab0-062e-4de4-9892-75a29231c480-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "cinder-30ab7053-52c5-455f-992b-6bb1b09d541e-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-30ab7053-52c5-455f-992b-6bb1b09d541e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "cinder-quobyte-30ab7053-52c5-455f-992b-6bb1b09d541e" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-30ab7053-52c5-455f-992b-6bb1b09d541e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Deleting offline snapshot 30ab7053-52c5-455f-992b-6bb1b09d541e of volume 7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] snapshot_file for this snap is: volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aea171-38f6-45f1-adbc-68335ff3da23]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:46 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.379s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf904f2-124d-4d97-be8e-f0321b5750c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3792c9-909d-45b4-ab1e-8a7b9e5af847]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 Jul 23 03:22:46 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:46 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Flow 'volume_create_manager' (3a8dbf24-464b-41e4-ad73-c30a1ebbf289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2056c7-f7b4-4b5d-bd99-47ba34ba370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2056c7-f7b4-4b5d-bd99-47ba34ba370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055688708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd85cf7d-7f15-49b4-ac23-da17a1323344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff71787951964a0bbc7f7ce97ca4b6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:47Z,use_quota=True,user_id='1c8d16f54da74ac4b62d81cfdfec7482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08f19ac-e414-46df-82f7-d0f40097a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08f19ac-e414-46df-82f7-d0f40097a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff4d18-40e0-4a9b-bcf3-6e0606a5211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff4d18-40e0-4a9b-bcf3-6e0606a5211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd85cf7d-7f15-49b4-ac23-da17a1323344', 'volume_name': 'volume-bd85cf7d-7f15-49b4-ac23-da17a1323344', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b168b8c0-b631-4ffa-ad0a-a571eba0a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b168b8c0-b631-4ffa-ad0a-a571eba0a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5031434-bd8c-46c6-bc97-2c4893453178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Volume bd85cf7d-7f15-49b4-ac23-da17a1323344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd85cf7d-7f15-49b4-ac23-da17a1323344', 'volume_size': 1} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055688708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd85cf7d-7f15-49b4-ac23-da17a1323344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff71787951964a0bbc7f7ce97ca4b6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:47Z,use_quota=True,user_id='1c8d16f54da74ac4b62d81cfdfec7482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Creating volume bd85cf7d-7f15-49b4-ac23-da17a1323344 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:47 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 1073741824 Jul 23 03:22:47 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e Jul 23 03:22:47 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7.30ab7053-52c5-455f-992b-6bb1b09d541e" returned: 0 in 0.248s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-30ab7053-52c5-455f-992b-6bb1b09d541e" released by "_delete_snapshot" :: held 1.509s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_snapshot" :: held 1.536s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Created reservations ['3a573f14-47dc-4c8b-8ce9-7c0fc7f8b4f9', '6000e33a-838d-494e-963d-75831231233a', '3f457a18-7e0c-4b3e-92bc-55b6b48e4b13', 'dae20661-f18a-4342-9b03-469c443b5438'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Delete snapshot completed successfully. Jul 23 03:22:47 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 1073741824" returned: 0 in 0.449s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-36d656c2-bc94-4131-9bd4-a7e8123fc87c tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-30ab7053-52c5-455f-992b-6bb1b09d541e-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 Jul 23 03:22:47 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:47 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5031434-bd8c-46c6-bc97-2c4893453178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd85cf7d-7f15-49b4-ac23-da17a1323344', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59d4e3c-0853-42d4-a1ca-0d43ab64b209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Volume volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 (bd85cf7d-7f15-49b4-ac23-da17a1323344): created successfully Jul 23 03:22:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59d4e3c-0853-42d4-a1ca-0d43ab64b209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Flow 'volume_create_manager' (3a8dbf24-464b-41e4-ad73-c30a1ebbf289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-38fdd25f-145c-4b6b-8e96-da5c6b7fa1b5 tempest-VolumesTransfersTest-1738561367 None] Created volume successfully. Jul 23 03:22:48 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.258s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "cinder-7bf904f2-124d-4d97-be8e-f0321b5750c7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-7bf904f2-124d-4d97-be8e-f0321b5750c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[40962ef7-9c30-4dd9-9652-39d7541a6123]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:48 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 Jul 23 03:22:48 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a35bde30-0431-4e20-8fb5-171c6556ae6b tempest-VolumesTransfersTest-1364715463 None] Transfer volume completed successfully. Jul 23 03:22:48 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7" returned: 0 in 0.405s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:48 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7 Jul 23 03:22:48 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:49 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7bf904f2-124d-4d97-be8e-f0321b5750c7" returned: 0 in 0.252s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-quobyte-7bf904f2-124d-4d97-be8e-f0321b5750c7" released by "delete_volume" :: held 0.717s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Created reservations ['c98c5bf6-930f-4e07-b8a7-c0e0126ff0b9', 'e05ae9bc-cc6d-474b-9855-ba0f492c6d4a', 'fc40a8c7-73b0-4b86-b4bc-ad02d948fc56', 'fcceb42f-fd8b-4321-94e9-1cf1c0a9f1de'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "cinder-bd85cf7d-7f15-49b4-ac23-da17a1323344-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-bd85cf7d-7f15-49b4-ac23-da17a1323344-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:49 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:49 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "cinder-quobyte-bd85cf7d-7f15-49b4-ac23-da17a1323344" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-quobyte-bd85cf7d-7f15-49b4-ac23-da17a1323344" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd53b0-1392-4ff4-96fe-097d0c6ba377]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:49 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 Jul 23 03:22:49 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:49 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Deleted volume successfully. Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fa54f426-2096-4e2e-8ba3-816f93e4f597 tempest-SnapshotsActionsTest-425046865 None] Lock "cinder-7bf904f2-124d-4d97-be8e-f0321b5750c7-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:49 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:49 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344 Jul 23 03:22:49 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:50 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd85cf7d-7f15-49b4-ac23-da17a1323344" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-quobyte-bd85cf7d-7f15-49b4-ac23-da17a1323344" released by "delete_volume" :: held 0.686s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Created reservations ['3caca037-dee7-4cbd-90ec-b2d56871e1e5', '34ddf774-16a7-4ddd-a68e-78389b44f676', '5c58b197-2800-48c3-8128-d1be8d1490af', '771ab741-a6a6-4322-9a32-839aa729ac5e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:50 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:50 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:50 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Deleted volume successfully. Jul 23 03:22:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5269e198-0573-4823-a22d-cb86dca39a05 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-bd85cf7d-7f15-49b4-ac23-da17a1323344-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Flow 'volume_create_manager' (22156e34-1c88-4e26-ae75-777c0ab0c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f3b10d-0688-4372-8c98-acb4d0569778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f3b10d-0688-4372-8c98-acb4d0569778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1210933915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff71787951964a0bbc7f7ce97ca4b6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:51Z,use_quota=True,user_id='1c8d16f54da74ac4b62d81cfdfec7482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45383aff-e087-48f8-847d-cd398fcb0cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45383aff-e087-48f8-847d-cd398fcb0cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399923b2-302f-43bf-8707-6267791d2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399923b2-302f-43bf-8707-6267791d2685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8', 'volume_name': 'volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2fd788-9be4-46dd-b6b8-f660d1b9fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2fd788-9be4-46dd-b6b8-f660d1b9fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e13b53-a270-4bdd-a479-7a11922424de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:51 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Volume a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8', 'volume_size': 1} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1210933915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff71787951964a0bbc7f7ce97ca4b6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:51Z,use_quota=True,user_id='1c8d16f54da74ac4b62d81cfdfec7482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Creating volume a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:51 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:51 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 1073741824 Jul 23 03:22:51 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 1073741824" returned: 0 in 0.738s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:52 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 Jul 23 03:22:52 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e13b53-a270-4bdd-a479-7a11922424de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e4235f-57a8-47e3-9fc6-67fd24c22816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:52 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Volume volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 (a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8): created successfully Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e4235f-57a8-47e3-9fc6-67fd24c22816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Flow 'volume_create_manager' (22156e34-1c88-4e26-ae75-777c0ab0c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c3bb6266-3a63-4b93-97a4-f4c5032d305d tempest-VolumesTransfersTest-1738561367 None] Created volume successfully. Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "cinder-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=112,cinder:SELECT=105,cinder:INSERT=29,cinder:DELETE=8 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "cinder-quobyte-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-quobyte-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7d4c3b-f5df-41e8-9410-0177f073e654]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:53 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 Jul 23 03:22:53 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:54 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" returned: 0 in 0.394s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:54 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8 Jul 23 03:22:54 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:54 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-quobyte-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8" released by "delete_volume" :: held 0.695s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Created reservations ['8977fd53-d51b-4119-8f07-2a4d0c191dd7', 'e56af3e9-117f-4dd5-aef3-8a4e4392fadd', 'e173c0a8-edf3-411d-aa0f-4d7a56a9b4be', 'a53af2e4-a65f-4f88-b762-6d4d4fa343cc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=110,cinder:SELECT=102,cinder:INSERT=39,cinder:DELETE=6 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:54 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:22:54 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:54 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.283s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Deleted volume successfully. Jul 23 03:22:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7e5d626c-ec43-4000-8e4c-d1d01720c104 tempest-VolumesTransfersTest-1554181869 None] Lock "cinder-a21733cf-e9b5-4c4d-9ce6-c2367f0acdd8-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (f884285f-012c-4a0b-b007-99e3d011181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005166e1-d991-4396-8ded-bb943b5b13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005166e1-d991-4396-8ded-bb943b5b13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2145273918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d44a563-db46-4c78-b8b7-864807897e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd06d669-5387-4769-8c53-aa09b5518300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd06d669-5387-4769-8c53-aa09b5518300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2cacbc-c884-473a-b6e9-10f42c3a4f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2cacbc-c884-473a-b6e9-10f42c3a4f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d44a563-db46-4c78-b8b7-864807897e37', 'volume_name': 'volume-2d44a563-db46-4c78-b8b7-864807897e37', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc434549-c6f3-4948-95d1-4b59d2fc361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc434549-c6f3-4948-95d1-4b59d2fc361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cff003-f1e5-460d-a45f-cb9bb003356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Volume 2d44a563-db46-4c78-b8b7-864807897e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d44a563-db46-4c78-b8b7-864807897e37', 'volume_size': 1} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2145273918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d44a563-db46-4c78-b8b7-864807897e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Creating volume 2d44a563-db46-4c78-b8b7-864807897e37 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:55 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:55 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 1073741824 Jul 23 03:22:55 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (4b8926db-d6f4-454a-b0c7-da1182522770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c11944-f89c-4b43-8441-02b1d3d9521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c11944-f89c-4b43-8441-02b1d3d9521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355662745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a4f293-b365-4493-9ec4-332f537d73ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82f81f-bd14-4262-a519-b45c21c7918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab82f81f-bd14-4262-a519-b45c21c7918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fc8950-007a-4587-8928-5f8c9666aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fc8950-007a-4587-8928-5f8c9666aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a4f293-b365-4493-9ec4-332f537d73ac', 'volume_name': 'volume-63a4f293-b365-4493-9ec4-332f537d73ac', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce91ca6-03d8-4994-b66b-1d86892019a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce91ca6-03d8-4994-b66b-1d86892019a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a6b32d-a6e3-4c76-a627-d2693e4644a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Volume 63a4f293-b365-4493-9ec4-332f537d73ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a4f293-b365-4493-9ec4-332f537d73ac', 'volume_size': 1} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:56 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 1073741824" returned: 0 in 0.599s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:56 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 Jul 23 03:22:56 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:56 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355662745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a4f293-b365-4493-9ec4-332f537d73ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Creating volume 63a4f293-b365-4493-9ec4-332f537d73ac {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:56 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cff003-f1e5-460d-a45f-cb9bb003356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d44a563-db46-4c78-b8b7-864807897e37', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac 1073741824 Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f48a3-3879-43a2-9ab5-f1e9ed8a024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:56 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Volume volume-2d44a563-db46-4c78-b8b7-864807897e37 (2d44a563-db46-4c78-b8b7-864807897e37): created successfully Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f48a3-3879-43a2-9ab5-f1e9ed8a024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (f884285f-012c-4a0b-b007-99e3d011181b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-464beb91-a7f2-456d-8c6d-f8a7ef250671 tempest-AttachVolumeNegativeTest-2811165 None] Created volume successfully. Jul 23 03:22:57 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac 1073741824" returned: 0 in 0.570s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:57 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac Jul 23 03:22:57 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Flow 'volume_create_manager' (b7814b8a-1a7b-4614-b2da-bf767b7a9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c3d4da-deb4-46cd-a279-727e3419b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c3d4da-deb4-46cd-a279-727e3419b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-719891554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c967d2f6-79e9-475d-8e93-277fd34ff8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a2c03f106c4285a0e52437a69cd7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:58Z,use_quota=True,user_id='8129937d47f0477087364ee59e2df6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f535472-0b42-4bae-97ad-f70eaed5d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f535472-0b42-4bae-97ad-f70eaed5d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0679a4f5-37d5-4e80-bebe-13a3256c2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0679a4f5-37d5-4e80-bebe-13a3256c2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c967d2f6-79e9-475d-8e93-277fd34ff8b5', 'volume_name': 'volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158418f-c7d1-4ac6-b074-0b700ec0e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8158418f-c7d1-4ac6-b074-0b700ec0e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee49f67a-321b-4bb3-bdaa-1421886fe0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume c967d2f6-79e9-475d-8e93-277fd34ff8b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5', 'volume_size': 1} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:57 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac" returned: 0 in 0.325s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-719891554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c967d2f6-79e9-475d-8e93-277fd34ff8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a2c03f106c4285a0e52437a69cd7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:58Z,use_quota=True,user_id='8129937d47f0477087364ee59e2df6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Creating volume c967d2f6-79e9-475d-8e93-277fd34ff8b5 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:57 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:57 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 1073741824 Jul 23 03:22:57 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a6b32d-a6e3-4c76-a627-d2693e4644a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a4f293-b365-4493-9ec4-332f537d73ac', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3bcd08-380e-4370-bcd7-a1b26f6ee4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:57 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Volume volume-63a4f293-b365-4493-9ec4-332f537d73ac (63a4f293-b365-4493-9ec4-332f537d73ac): created successfully Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3bcd08-380e-4370-bcd7-a1b26f6ee4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (4b8926db-d6f4-454a-b0c7-da1182522770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d6df3c7f-77da-4da9-82d9-294c46519e59 tempest-AttachVolumeTestJSON-1770636334 None] Created volume successfully. Jul 23 03:22:58 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 1073741824" returned: 0 in 0.677s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:58 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 Jul 23 03:22:58 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:58 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5" returned: 0 in 0.351s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee49f67a-321b-4bb3-bdaa-1421886fe0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6442aa1-76e2-454b-961f-bd0b7c8ae161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 (c967d2f6-79e9-475d-8e93-277fd34ff8b5): created successfully Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6442aa1-76e2-454b-961f-bd0b7c8ae161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Flow 'volume_create_manager' (b7814b8a-1a7b-4614-b2da-bf767b7a9369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-19b80e58-3ea3-4f15-acc9-e50496828979 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Created volume successfully. Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-483d87cd-f187-4b36-83c1-b0bf9989f614 req-a106f11a-28b1-4bf0-aaf8-516822104989 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-483d87cd-f187-4b36-83c1-b0bf9989f614 req-a106f11a-28b1-4bf0-aaf8-516822104989 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-483d87cd-f187-4b36-83c1-b0bf9989f614 req-a106f11a-28b1-4bf0-aaf8-516822104989 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-483d87cd-f187-4b36-83c1-b0bf9989f614 req-a106f11a-28b1-4bf0-aaf8-516822104989 tempest-AttachVolumeTestJSON-1770636334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-63a4f293-b365-4493-9ec4-332f537d73ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8a1962a-1d0e-494a-ad24-8469f066f517', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-483d87cd-f187-4b36-83c1-b0bf9989f614 req-a106f11a-28b1-4bf0-aaf8-516822104989 tempest-AttachVolumeTestJSON-1770636334 None] attachment_update completed successfully. Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-c60d1a55-7f4a-43eb-8574-33534f954d78 req-1a490c38-bba7-4135-b611-641c64b8fa7f tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-c60d1a55-7f4a-43eb-8574-33534f954d78 req-1a490c38-bba7-4135-b611-641c64b8fa7f tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-c60d1a55-7f4a-43eb-8574-33534f954d78 req-1a490c38-bba7-4135-b611-641c64b8fa7f tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-c60d1a55-7f4a-43eb-8574-33534f954d78 req-1a490c38-bba7-4135-b611-641c64b8fa7f tempest-AttachVolumeNegativeTest-2811165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-2d44a563-db46-4c78-b8b7-864807897e37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e5bbee3-a60b-4e9b-afa7-2e1af4f2dc4c', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-c60d1a55-7f4a-43eb-8574-33534f954d78 req-1a490c38-bba7-4135-b611-641c64b8fa7f tempest-AttachVolumeNegativeTest-2811165 None] attachment_update completed successfully. Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "cinder-c967d2f6-79e9-475d-8e93-277fd34ff8b5-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "cinder-c967d2f6-79e9-475d-8e93-277fd34ff8b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "cinder-quobyte-c967d2f6-79e9-475d-8e93-277fd34ff8b5" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "cinder-quobyte-c967d2f6-79e9-475d-8e93-277fd34ff8b5" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faadd96-9b7b-4f03-83a8-8abb3e8d5690]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:00 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 Jul 23 03:23:00 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:00 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5" returned: 0 in 0.510s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:00 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5 Jul 23 03:23:00 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:00 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c967d2f6-79e9-475d-8e93-277fd34ff8b5" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "cinder-quobyte-c967d2f6-79e9-475d-8e93-277fd34ff8b5" released by "delete_volume" :: held 0.896s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Created reservations ['9ef62e43-48e4-42d6-ba47-3162920be54c', '6dc7faf4-5003-43b9-8bb7-9b450751711d', '10b4478d-3eb7-4979-a6e8-969d90824bd6', '5b127e57-9cf0-4076-9c6a-88764325e9fa'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:01 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:01 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:01 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Deleted volume successfully. Jul 23 03:23:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-effcfb14-8ffe-4b45-838d-633be4248022 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "cinder-c967d2f6-79e9-475d-8e93-277fd34ff8b5-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Flow 'volume_create_manager' (982a4e1f-46b5-4e1c-9bba-d211e47c8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119d7320-9b3c-4491-9640-4d45e24afa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119d7320-9b3c-4491-9640-4d45e24afa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-460321714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed6bb42-afbe-4719-9c8c-265a030034e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a2c03f106c4285a0e52437a69cd7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:02Z,use_quota=True,user_id='8129937d47f0477087364ee59e2df6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9b16ef-d669-47de-9daf-2004d95820c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9b16ef-d669-47de-9daf-2004d95820c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907bb1e1-e284-4a28-b0b4-48fc515700fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907bb1e1-e284-4a28-b0b4-48fc515700fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed6bb42-afbe-4719-9c8c-265a030034e2', 'volume_name': 'volume-4ed6bb42-afbe-4719-9c8c-265a030034e2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705400b0-170a-47c6-a0c2-ad993dfae3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705400b0-170a-47c6-a0c2-ad993dfae3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aaec95-be39-4aac-9fb7-20777369705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume 4ed6bb42-afbe-4719-9c8c-265a030034e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed6bb42-afbe-4719-9c8c-265a030034e2', 'volume_size': 1} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-460321714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed6bb42-afbe-4719-9c8c-265a030034e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a2c03f106c4285a0e52437a69cd7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:02Z,use_quota=True,user_id='8129937d47f0477087364ee59e2df6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Creating volume 4ed6bb42-afbe-4719-9c8c-265a030034e2 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:02 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:02 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 1073741824 Jul 23 03:23:02 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:02 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 1073741824" returned: 0 in 0.563s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-60298f15-d3c6-4985-b9e2-1af3dc576be3 req-797a5739-54dd-406e-9427-79b1a8622d22 tempest-AttachVolumeNegativeTest-2811165 None] Terminate volume connection completed successfully. Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-60298f15-d3c6-4985-b9e2-1af3dc576be3 req-797a5739-54dd-406e-9427-79b1a8622d22 tempest-AttachVolumeNegativeTest-2811165 None] Deleting attachment 7e5bbee3-a60b-4e9b-afa7-2e1af4f2dc4c. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:02 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 Jul 23 03:23:02 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:03 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aaec95-be39-4aac-9fb7-20777369705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed6bb42-afbe-4719-9c8c-265a030034e2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59e6d13-e571-469e-80dd-fb87a455ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Volume volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 (4ed6bb42-afbe-4719-9c8c-265a030034e2): created successfully Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59e6d13-e571-469e-80dd-fb87a455ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Flow 'volume_create_manager' (982a4e1f-46b5-4e1c-9bba-d211e47c8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c8eb958d-fff5-4101-92d4-07b354fd2d96 tempest-VolumeQuotasAdminTestJSON-1472789622 None] Created volume successfully. Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Flow 'volume_create_manager' (f895403e-fb95-4914-ae0a-500ffa9a5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff5df52-dc77-4ac5-a199-464604fc7332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff5df52-dc77-4ac5-a199-464604fc7332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-620213706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6894be69188d418d89d90e4c60f96d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='e629cde1d9ad46c6b389cb0cd96812a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b9ff44-db69-4cbe-84e8-7f512d0aa002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b9ff44-db69-4cbe-84e8-7f512d0aa002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfc0e98-bd6d-443a-9684-be7bf6b0c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfc0e98-bd6d-443a-9684-be7bf6b0c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca', 'volume_name': 'volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa61314-effe-473b-b9b7-ba3357665ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa61314-effe-473b-b9b7-ba3357665ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7947d2-884b-4ee6-baa8-4dfa29d8f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Volume 8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca', 'volume_size': 1} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-620213706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6894be69188d418d89d90e4c60f96d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='e629cde1d9ad46c6b389cb0cd96812a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Creating volume 8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:04 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca 1073741824 Jul 23 03:23:04 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f757b7f0-cdb3-4ad5-b774-cae37fbddc31 tempest-VolumeQuotasAdminTestJSON-2012856262 None] Transfer volume completed successfully. Jul 23 03:23:05 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca 1073741824" returned: 0 in 0.827s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:05 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca Jul 23 03:23:05 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:06 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" returned: 0 in 0.360s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7947d2-884b-4ee6-baa8-4dfa29d8f19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa4c4c6-01be-4015-b891-7976de9f5193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:06 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Volume volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca (8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca): created successfully Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa4c4c6-01be-4015-b891-7976de9f5193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Flow 'volume_create_manager' (f895403e-fb95-4914-ae0a-500ffa9a5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-279f66c3-29a2-4b99-9445-dd639cd6e865 tempest-VolumesTransfersV357Test-1090367884 None] Created volume successfully. Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Acquiring lock "cinder-4ed6bb42-afbe-4719-9c8c-265a030034e2-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "cinder-4ed6bb42-afbe-4719-9c8c-265a030034e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Acquiring lock "cinder-quobyte-4ed6bb42-afbe-4719-9c8c-265a030034e2" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "cinder-quobyte-4ed6bb42-afbe-4719-9c8c-265a030034e2" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c6a553-f579-46fa-b642-6fb6b4c8a091]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 Jul 23 03:23:07 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2" returned: 0 in 0.882s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2 Jul 23 03:23:07 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-427dcf1d-7f6a-4b73-8f30-661f8080b57b tempest-VolumesTransfersV357Test-312100456 None] Transfer volume completed successfully. Jul 23 03:23:08 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4ed6bb42-afbe-4719-9c8c-265a030034e2" returned: 0 in 0.523s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "cinder-quobyte-4ed6bb42-afbe-4719-9c8c-265a030034e2" released by "delete_volume" :: held 1.500s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Created reservations ['4dade4b7-a4c9-475b-9fcf-196c5563b8c4', 'ca97134e-c15a-40f5-8afd-afcfc0cdfc0f', '2cda2ea7-c1cf-4ee1-a168-f260d0047d86', 'ba554470-2282-4262-bcaa-d31249397cd0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:08 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "cinder-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "cinder-quobyte-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:08 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Deleted volume successfully. Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-quobyte-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d646e3a-aa52-4de3-bfd7-25213200a43d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5b71f881-5b12-44e5-a899-5ecb3f2dec34 tempest-VolumeQuotasAdminTestJSON-2099161313 None] Lock "cinder-4ed6bb42-afbe-4719-9c8c-265a030034e2-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:08 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca Jul 23 03:23:08 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:09 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" returned: 0 in 0.521s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:09 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca Jul 23 03:23:09 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:09 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" returned: 0 in 0.660s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-quobyte-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca" released by "delete_volume" :: held 1.243s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Created reservations ['2e5a8299-cab1-4395-b7a1-ec216ab76074', 'c90cb31b-e871-4340-b848-3836b6eddaba', '1a13435c-b046-4a78-bd3e-5c64a8c38d10', 'e68ba651-8f20-43b0-bf15-c8e76028ed69'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:10 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:10 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:10 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Deleted volume successfully. Jul 23 03:23:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2c04167f-afef-4e3c-aca4-46ffa4b713c0 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-8dd6fcc4-0a58-4c79-824d-0b48d4b0aaca-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Flow 'volume_create_manager' (b60acb16-d2a9-483c-83dd-cab1bebcc739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875e9cf-f5bf-4181-8a59-2c207d52deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875e9cf-f5bf-4181-8a59-2c207d52deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1424386619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6894be69188d418d89d90e4c60f96d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:12Z,use_quota=True,user_id='e629cde1d9ad46c6b389cb0cd96812a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f8634d-8d1f-4bc8-99db-350ff8968928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f8634d-8d1f-4bc8-99db-350ff8968928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd79dfa-02e2-4230-b451-189d02a6a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd79dfa-02e2-4230-b451-189d02a6a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66', 'volume_name': 'volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bc914e-a11f-4591-b74f-7bc8715cd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bc914e-a11f-4591-b74f-7bc8715cd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b4a1c9-fc49-4b71-acf0-6d38392fad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Volume 8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66', 'volume_size': 1} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1424386619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6894be69188d418d89d90e4c60f96d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:12Z,use_quota=True,user_id='e629cde1d9ad46c6b389cb0cd96812a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Creating volume 8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:11 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:11 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 1073741824 Jul 23 03:23:11 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:12 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 1073741824" returned: 0 in 0.774s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:12 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 Jul 23 03:23:12 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:13 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b4a1c9-fc49-4b71-acf0-6d38392fad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc91121-cb00-4bed-ab07-a76d74d491f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:13 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Volume volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 (8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66): created successfully Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc91121-cb00-4bed-ab07-a76d74d491f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Flow 'volume_create_manager' (b60acb16-d2a9-483c-83dd-cab1bebcc739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-59e5aa42-d950-44bd-94d8-6bebde1db3d1 tempest-VolumesTransfersV357Test-1090367884 None] Created volume successfully. Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "cinder-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "cinder-quobyte-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-quobyte-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[527f7b34-d1d6-411c-8fe1-4e85a176ddc7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:14 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 Jul 23 03:23:14 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:14 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" returned: 0 in 0.500s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:14 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66 Jul 23 03:23:14 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:15 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-quobyte-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66" released by "delete_volume" :: held 0.995s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Created reservations ['cd0143d5-416e-45da-9ff0-0ae8244d026f', '47f95ffb-7c45-4e13-b189-aa3983194647', 'e57dd824-d268-46e8-9789-0f1bce291ecf', '18d03d30-5369-41e0-9c47-32edde868353'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:15 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:15 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:15 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.400s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:15 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Deleted volume successfully. Jul 23 03:23:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-41e695f6-bc82-43b2-87b7-baa184740ea8 tempest-VolumesTransfersV357Test-1877788030 None] Lock "cinder-8de0a4fd-702a-4f63-a9d9-f2ccd5e00d66-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Flow 'volume_create_manager' (f35e898a-94ff-4b55-9a2f-9e18f4a27486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1825f9e9-1dd6-4452-85a3-c1266ac5f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1825f9e9-1dd6-4452-85a3-c1266ac5f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1716625181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128890a8-bfd1-423f-a026-3125a8c95eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7193a5992c6c41279ab3031ec6f7df99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:21Z,use_quota=True,user_id='6138ca458a034d819ccc1a46d32a125d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfbf453-25fb-4471-add3-95033d48854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfbf453-25fb-4471-add3-95033d48854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acca02b-05c6-4742-a8a2-08bd26fe23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acca02b-05c6-4742-a8a2-08bd26fe23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128890a8-bfd1-423f-a026-3125a8c95eed', 'volume_name': 'volume-128890a8-bfd1-423f-a026-3125a8c95eed', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62946919-6a4d-4778-8358-ce42a5fc6073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62946919-6a4d-4778-8358-ce42a5fc6073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395ce1e4-c129-4317-9c7b-e72d6d0a9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:21 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Volume 128890a8-bfd1-423f-a026-3125a8c95eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128890a8-bfd1-423f-a026-3125a8c95eed', 'volume_size': 1} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1716625181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128890a8-bfd1-423f-a026-3125a8c95eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7193a5992c6c41279ab3031ec6f7df99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:21Z,use_quota=True,user_id='6138ca458a034d819ccc1a46d32a125d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Creating volume 128890a8-bfd1-423f-a026-3125a8c95eed {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:21 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:21 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed 1073741824 Jul 23 03:23:21 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:22 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed 1073741824" returned: 0 in 0.966s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:22 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed Jul 23 03:23:22 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:22 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed" returned: 0 in 0.603s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395ce1e4-c129-4317-9c7b-e72d6d0a9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128890a8-bfd1-423f-a026-3125a8c95eed', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964b072a-83a5-4a41-9c67-1801e1e45bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:22 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Volume volume-128890a8-bfd1-423f-a026-3125a8c95eed (128890a8-bfd1-423f-a026-3125a8c95eed): created successfully Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964b072a-83a5-4a41-9c67-1801e1e45bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Flow 'volume_create_manager' (f35e898a-94ff-4b55-9a2f-9e18f4a27486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ad45a139-35ae-410e-889a-1930535f242e tempest-VolumesServicesTestJSON-716823779 None] Created volume successfully. Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Acquiring lock "cinder-128890a8-bfd1-423f-a026-3125a8c95eed-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "cinder-128890a8-bfd1-423f-a026-3125a8c95eed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Acquiring lock "cinder-quobyte-128890a8-bfd1-423f-a026-3125a8c95eed" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "cinder-quobyte-128890a8-bfd1-423f-a026-3125a8c95eed" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d871c0-43b9-46a6-a1c4-3e1b8e6e54eb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:23 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed Jul 23 03:23:23 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:24 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed" returned: 0 in 0.520s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:24 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed Jul 23 03:23:24 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:24 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-128890a8-bfd1-423f-a026-3125a8c95eed" returned: 0 in 0.347s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "cinder-quobyte-128890a8-bfd1-423f-a026-3125a8c95eed" released by "delete_volume" :: held 0.957s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Created reservations ['40b6f5a1-23fe-4376-9104-d18f191b5bae', '5c9edf56-f6af-4ece-925f-53b3dceaf4c4', '0b98dc43-5acf-4ab9-8aa0-6d5f33460340', 'a86d8ccb-4726-44d2-b7fd-688a33b2baeb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:24 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:24 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:25 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.671s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:25 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Deleted volume successfully. Jul 23 03:23:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d63f0a34-d63e-43e5-a72c-7a3f70dceb94 tempest-VolumesServicesTestJSON-716823779 None] Lock "cinder-128890a8-bfd1-423f-a026-3125a8c95eed-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Flow 'volume_create_manager' (b8bcc81f-7c3f-4dcf-98ab-645328874ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc66fe2b-bd6b-40d0-8411-13f3983e96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc66fe2b-bd6b-40d0-8411-13f3983e96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1141685199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ccf81-22d6-4dd3-9d84-229930010c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67236d08f70242ff87f16fe93d5eec2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:27Z,use_quota=True,user_id='49262a0c5eb84ece887bcedc10f0ba4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd28b97-d0ac-4246-be63-45af93fedc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd28b97-d0ac-4246-be63-45af93fedc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4653a0f3-8bf8-4233-8307-7357072f0f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4653a0f3-8bf8-4233-8307-7357072f0f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186ccf81-22d6-4dd3-9d84-229930010c14', 'volume_name': 'volume-186ccf81-22d6-4dd3-9d84-229930010c14', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd52c3d-e445-43ee-b0c9-38f4b8e8f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd52c3d-e445-43ee-b0c9-38f4b8e8f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786dac6d-5a10-4bff-baaa-238afb0dbe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:27 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Volume 186ccf81-22d6-4dd3-9d84-229930010c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186ccf81-22d6-4dd3-9d84-229930010c14', 'volume_size': 1} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1141685199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ccf81-22d6-4dd3-9d84-229930010c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67236d08f70242ff87f16fe93d5eec2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:27Z,use_quota=True,user_id='49262a0c5eb84ece887bcedc10f0ba4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Creating volume 186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:27 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:27 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 1073741824 Jul 23 03:23:27 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:28 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 1073741824" returned: 0 in 0.679s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:28 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:28 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:28 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.433s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786dac6d-5a10-4bff-baaa-238afb0dbe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186ccf81-22d6-4dd3-9d84-229930010c14', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70362631-033c-4fe2-be99-a41d3bb87c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:28 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Volume volume-186ccf81-22d6-4dd3-9d84-229930010c14 (186ccf81-22d6-4dd3-9d84-229930010c14): created successfully Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70362631-033c-4fe2-be99-a41d3bb87c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Flow 'volume_create_manager' (b8bcc81f-7c3f-4dcf-98ab-645328874ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ce1c723d-48b5-416d-a029-9ebb27a0a0d7 tempest-VolumesCloneTest-1619101086 None] Created volume successfully. Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Flow 'volume_create_manager' (323946ca-779a-4e5f-8915-3532eb211e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905ba57-f034-41d3-a328-5d40db8bc72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905ba57-f034-41d3-a328-5d40db8bc72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-662804224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8f0e0f-a532-4224-adb5-fb90f7af351a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67236d08f70242ff87f16fe93d5eec2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=186ccf81-22d6-4dd3-9d84-229930010c14,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:30Z,use_quota=True,user_id='49262a0c5eb84ece887bcedc10f0ba4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8208ffa5-baa3-4cb6-9d17-22cfac25fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8208ffa5-baa3-4cb6-9d17-22cfac25fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85fbfe8-53b0-4ebd-adef-199e479ab68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85fbfe8-53b0-4ebd-adef-199e479ab68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d8f0e0f-a532-4224-adb5-fb90f7af351a', 'volume_name': 'volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a', 'volume_size': 2, 'source_volid': '186ccf81-22d6-4dd3-9d84-229930010c14', 'source_volstatus': 'available'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b385d6f-5eb3-47b7-aa40-d621a7e9a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b385d6f-5eb3-47b7-aa40-d621a7e9a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abef23f5-c79e-413a-8bee-8a6491fc31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:30 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Volume 2d8f0e0f-a532-4224-adb5-fb90f7af351a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a', 'volume_size': 2, 'source_volid': '186ccf81-22d6-4dd3-9d84-229930010c14', 'source_volstatus': 'available'} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:30 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Cloning volume 186ccf81-22d6-4dd3-9d84-229930010c14 to volume 2d8f0e0f-a532-4224-adb5-fb90f7af351a Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Creating offline snapshot a61a5363-aef3-42b8-b08a-ae3b3d61b285 of volume 186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[59445219-83e3-4215-a03b-977f9033023e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:30 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.438s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 1G Jul 23 03:23:30 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 1G" returned: 0 in 0.540s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-186ccf81-22d6-4dd3-9d84-229930010c14 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:31 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-186ccf81-22d6-4dd3-9d84-229930010c14 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:31 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-186ccf81-22d6-4dd3-9d84-229930010c14 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.313s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 is being set with open permissions: ugo+rw Jul 23 03:23:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:31 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:31 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-2e8e8646-8257-43f6-a29a-ae599df475ac req-bdc24df2-241e-4e33-97e3-0b04220d4f97 tempest-AttachVolumeTestJSON-1770636334 None] Terminate volume connection completed successfully. Jul 23 03:23:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-2e8e8646-8257-43f6-a29a-ae599df475ac req-bdc24df2-241e-4e33-97e3-0b04220d4f97 tempest-AttachVolumeTestJSON-1770636334 None] Deleting attachment f8a1962a-1d0e-494a-ad24-8469f066f517. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:23:32 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.393s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info Jul 23 03:23:32 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info is being set with open permissions: ugo+rw Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info Jul 23 03:23:32 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.info" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] snapshot: a61a5363-aef3-42b8-b08a-ae3b3d61b285, volume: 2d8f0e0f-a532-4224-adb5-fb90f7af351a, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e18b2e-e7df-496b-88ce-ff26b4390126]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:33 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Flow 'volume_create_manager' (23b5e5a2-84d6-46ad-821e-f972cc3e7b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e89e3d-9161-4964-9a17-13b97e39f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e89e3d-9161-4964-9a17-13b97e39f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-585479642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a4a829-ac32-488f-9fd4-b33c4021f39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c68c3e784b4699834f9dbc10feb429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='c0566ce0716e443280e7951c6b29cc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff78a47f-c059-4f43-9871-5f92838de9c4),volume_type_id=ff78a47f-c059-4f43-9871-5f92838de9c4)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b53661-15a3-46fc-9031-dbc5be11b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b53661-15a3-46fc-9031-dbc5be11b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0b6341-c0b5-4153-9411-a9ae6132fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0b6341-c0b5-4153-9411-a9ae6132fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a4a829-ac32-488f-9fd4-b33c4021f39e', 'volume_name': 'volume-18a4a829-ac32-488f-9fd4-b33c4021f39e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89915cfe-c42c-4740-a62a-7b0f20ebbde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89915cfe-c42c-4740-a62a-7b0f20ebbde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd9b7a-174a-475c-997d-7e7368cbf759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Volume 18a4a829-ac32-488f-9fd4-b33c4021f39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a4a829-ac32-488f-9fd4-b33c4021f39e', 'volume_size': 1} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-186ccf81-22d6-4dd3-9d84-229930010c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f61213-ddb7-4d17-a181-90456f5ba591]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:33 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.350s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:23:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a Jul 23 03:23:33 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:40 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a" returned: 0 in 6.199s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4cc38-8fd2-4161-92f7-2d034cfc502a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:40 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:40 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:40 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.618s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:23:40 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Converted 1024.00 MB image at 165.14 MB/s Jul 23 03:23:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a is being set with open permissions: ugo+rw Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:40 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a Jul 23 03:23:40 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:40 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" released by "_copy_volume_from_snapshot" :: held 7.994s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-quobyte-a61a5363-aef3-42b8-b08a-ae3b3d61b285" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-a61a5363-aef3-42b8-b08a-ae3b3d61b285" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Deleting offline snapshot a61a5363-aef3-42b8-b08a-ae3b3d61b285 of volume 186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] snapshot_file for this snap is: volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f204ba2-1cd9-4f3f-9841-798520a2c79a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:41 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:41 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:41 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-186ccf81-22d6-4dd3-9d84-229930010c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c30ff2-2183-47da-99bd-fe64284ae00b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:41 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:41 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:41 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:41 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:41 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:42 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:42 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285 Jul 23 03:23:42 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:42 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14.a61a5363-aef3-42b8-b08a-ae3b3d61b285" returned: 0 in 0.240s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-a61a5363-aef3-42b8-b08a-ae3b3d61b285" released by "_delete_snapshot" :: held 1.458s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.139s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.018s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-585479642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a4a829-ac32-488f-9fd4-b33c4021f39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c68c3e784b4699834f9dbc10feb429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='c0566ce0716e443280e7951c6b29cc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff78a47f-c059-4f43-9871-5f92838de9c4),volume_type_id=ff78a47f-c059-4f43-9871-5f92838de9c4)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Creating volume 18a4a829-ac32-488f-9fd4-b33c4021f39e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:42 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abef23f5-c79e-413a-8bee-8a6491fc31c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a', 'volume_size': 2, 'source_volid': '186ccf81-22d6-4dd3-9d84-229930010c14', 'source_volstatus': 'available'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e 1073741824 Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9fd4d7-cd0f-421e-9666-5cea9c67bf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:42 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:42 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Volume volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a (2d8f0e0f-a532-4224-adb5-fb90f7af351a): created successfully Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9fd4d7-cd0f-421e-9666-5cea9c67bf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Flow 'volume_create_manager' (323946ca-779a-4e5f-8915-3532eb211e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-33fe323e-e48f-449c-8106-d8bc95fdc6bf tempest-VolumesCloneTest-1619101086 None] Created volume successfully. Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-2d8f0e0f-a532-4224-adb5-fb90f7af351a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-2d8f0e0f-a532-4224-adb5-fb90f7af351a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9934bc71-7ae1-4d19-a7da-66c73b508718]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e 1073741824" returned: 0 in 0.672s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a Jul 23 03:23:43 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e Jul 23 03:23:43 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a" returned: 0 in 0.458s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:43 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a Jul 23 03:23:43 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd9b7a-174a-475c-997d-7e7368cbf759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a4a829-ac32-488f-9fd4-b33c4021f39e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e3ba1e-5a73-4601-b947-c2db86c9eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Volume volume-18a4a829-ac32-488f-9fd4-b33c4021f39e (18a4a829-ac32-488f-9fd4-b33c4021f39e): created successfully Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e3ba1e-5a73-4601-b947-c2db86c9eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Flow 'volume_create_manager' (23b5e5a2-84d6-46ad-821e-f972cc3e7b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41c80559-ec52-421d-bb7e-81deefb7dece tempest-VolumeTypesAccessTest-1953325452 None] Created volume successfully. Jul 23 03:23:43 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d8f0e0f-a532-4224-adb5-fb90f7af351a" returned: 0 in 0.290s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-2d8f0e0f-a532-4224-adb5-fb90f7af351a" released by "delete_volume" :: held 0.805s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Created reservations ['3080a004-6fab-467a-a215-09d924610fb7', '9db1aa6e-8792-4612-ae24-4ea998bf5322', '198812a8-2155-46a6-a57f-c072e51a6b77', 'b5bbb7b3-99a2-42ad-b74e-9dce2b2ee419'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:43 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-186ccf81-22d6-4dd3-9d84-229930010c14-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-186ccf81-22d6-4dd3-9d84-229930010c14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:44 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Deleted volume successfully. Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "cinder-quobyte-186ccf81-22d6-4dd3-9d84-229930010c14" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea240092-fe2f-47b5-9ff8-f0f2a99a9c04 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-2d8f0e0f-a532-4224-adb5-fb90f7af351a-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-186ccf81-22d6-4dd3-9d84-229930010c14" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[969fb677-3ace-4ff3-b3e7-d63f823ba138]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:44 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:44 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Acquiring lock "cinder-18a4a829-ac32-488f-9fd4-b33c4021f39e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:44 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.416s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "cinder-18a4a829-ac32-488f-9fd4-b33c4021f39e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:44 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14 Jul 23 03:23:44 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Acquiring lock "cinder-quobyte-18a4a829-ac32-488f-9fd4-b33c4021f39e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "cinder-quobyte-18a4a829-ac32-488f-9fd4-b33c4021f39e" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd17d3-7e8e-41dc-822c-7c94ddfd43da]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e Jul 23 03:23:45 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-186ccf81-22d6-4dd3-9d84-229930010c14" returned: 0 in 0.368s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-quobyte-186ccf81-22d6-4dd3-9d84-229930010c14" released by "delete_volume" :: held 0.858s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Created reservations ['6a497b92-eac2-4afa-9504-abc274be694d', '8401f4de-3081-4b37-88ef-267c23b369d7', '375e4199-d520-459f-9521-9619d2e0e142', 'f4b0f755-117b-467f-8cdf-b487080a0f03'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:45 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e" returned: 0 in 0.536s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e Jul 23 03:23:45 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Deleted volume successfully. Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-73a51c79-5c52-4a2c-a455-945105d363c2 tempest-VolumesCloneTest-1619101086 None] Lock "cinder-186ccf81-22d6-4dd3-9d84-229930010c14-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:45 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18a4a829-ac32-488f-9fd4-b33c4021f39e" returned: 0 in 0.365s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "cinder-quobyte-18a4a829-ac32-488f-9fd4-b33c4021f39e" released by "delete_volume" :: held 0.950s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:45 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-161509965 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-161509965, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:45 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-161509965 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-161509965, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Created reservations ['01cf6d37-89ec-4ea2-8eef-389f5229103a', '5a4d3bfe-c3a6-4ec4-a96e-740ab25de1bf', '7189fc5f-26c1-4f1c-9776-e878dfbf0375', '0556b452-3efa-4b47-b9da-3dca7a9edf8e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:46 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:46 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:46 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Deleted volume successfully. Jul 23 03:23:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bace639a-2b5d-4ebd-9e99-c0ffb6e935d3 tempest-VolumeTypesAccessTest-1953325452 None] Lock "cinder-18a4a829-ac32-488f-9fd4-b33c4021f39e-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:47 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:23:47 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:48 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.347s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:23:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (9453364a-1004-4ce7-9ab7-14c4fd5358f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7390458-1acc-486d-aa1f-43ac7dd20148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7390458-1acc-486d-aa1f-43ac7dd20148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1028207117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c96de4-d925-436a-8a84-dd6c0d435152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:49Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad50f7d-d28d-49c7-9631-e2a21c8ee871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad50f7d-d28d-49c7-9631-e2a21c8ee871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df66b8f-9fe6-4ee0-a1df-866dbcaf04ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df66b8f-9fe6-4ee0-a1df-866dbcaf04ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c96de4-d925-436a-8a84-dd6c0d435152', 'volume_name': 'volume-98c96de4-d925-436a-8a84-dd6c0d435152', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d171a2f2-9063-403c-aceb-e867e79cabda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d171a2f2-9063-403c-aceb-e867e79cabda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba803c3-c52d-4760-9e61-ce64ffef17fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Volume 98c96de4-d925-436a-8a84-dd6c0d435152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c96de4-d925-436a-8a84-dd6c0d435152', 'volume_size': 1} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1028207117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c96de4-d925-436a-8a84-dd6c0d435152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0bd24fce8f46c2839e6761ecec6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:49Z,use_quota=True,user_id='708e76edbe084a94b6d70c31ac22d466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Creating volume 98c96de4-d925-436a-8a84-dd6c0d435152 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:49 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:49 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 1073741824 Jul 23 03:23:49 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Flow 'volume_create_manager' (0c7890ec-88a5-4f65-b0ff-0af8d9573b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317549e8-54b1-4c3f-8463-3432dda4098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317549e8-54b1-4c3f-8463-3432dda4098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759070122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43302248-3889-486d-9d4a-bd3c85377b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3978bb89ff949ccb147900c4d356b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:50Z,use_quota=True,user_id='c6973717da534e2f93dc4cad91e05af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6b61a4-76a3-44d8-a5c2-0172345642e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6b61a4-76a3-44d8-a5c2-0172345642e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9a0cd5-3fc2-41ba-b468-4c125536cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9a0cd5-3fc2-41ba-b468-4c125536cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43302248-3889-486d-9d4a-bd3c85377b13', 'volume_name': 'volume-43302248-3889-486d-9d4a-bd3c85377b13', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff89d9c-629f-419d-ba66-57ff75eebfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff89d9c-629f-419d-ba66-57ff75eebfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04244a1b-4b84-4830-a2ce-49884ef3307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Volume 43302248-3889-486d-9d4a-bd3c85377b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43302248-3889-486d-9d4a-bd3c85377b13', 'volume_size': 1} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:49 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 1073741824" returned: 0 in 0.566s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:50 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 Jul 23 03:23:50 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:50 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759070122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43302248-3889-486d-9d4a-bd3c85377b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3978bb89ff949ccb147900c4d356b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:50Z,use_quota=True,user_id='c6973717da534e2f93dc4cad91e05af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Creating volume 43302248-3889-486d-9d4a-bd3c85377b13 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:50 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:50 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 1073741824 Jul 23 03:23:50 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba803c3-c52d-4760-9e61-ce64ffef17fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c96de4-d925-436a-8a84-dd6c0d435152', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f9c950-0570-4228-812f-b3edaafab8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Volume volume-98c96de4-d925-436a-8a84-dd6c0d435152 (98c96de4-d925-436a-8a84-dd6c0d435152): created successfully Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f9c950-0570-4228-812f-b3edaafab8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Flow 'volume_create_manager' (9453364a-1004-4ce7-9ab7-14c4fd5358f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-53ea1408-4d77-4629-9f2a-7ebd4d2fc9f6 tempest-AttachVolumeNegativeTest-2811165 None] Created volume successfully. Jul 23 03:23:50 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 1073741824" returned: 0 in 0.575s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:50 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 Jul 23 03:23:50 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13" returned: 0 in 0.315s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04244a1b-4b84-4830-a2ce-49884ef3307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43302248-3889-486d-9d4a-bd3c85377b13', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b75133-c2f1-4f4f-b955-2314a843f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:51 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Volume volume-43302248-3889-486d-9d4a-bd3c85377b13 (43302248-3889-486d-9d4a-bd3c85377b13): created successfully Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b75133-c2f1-4f4f-b955-2314a843f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Flow 'volume_create_manager' (0c7890ec-88a5-4f65-b0ff-0af8d9573b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e2d0842d-aafc-4d9e-b4be-d3c65728938f tempest-VolumesNegativeTest-495302352 None] Created volume successfully. Jul 23 03:23:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6d4d4d22-6a76-4a41-8413-337e05065c05 req-657fe829-1762-4aa9-a854-11cc527e8cd9 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6d4d4d22-6a76-4a41-8413-337e05065c05 req-657fe829-1762-4aa9-a854-11cc527e8cd9 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-6d4d4d22-6a76-4a41-8413-337e05065c05 req-657fe829-1762-4aa9-a854-11cc527e8cd9 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-6d4d4d22-6a76-4a41-8413-337e05065c05 req-657fe829-1762-4aa9-a854-11cc527e8cd9 tempest-AttachVolumeNegativeTest-2811165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-98c96de4-d925-436a-8a84-dd6c0d435152', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9742ed95-1491-4ce0-a84e-43beeee22ab3', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:23:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-6d4d4d22-6a76-4a41-8413-337e05065c05 req-657fe829-1762-4aa9-a854-11cc527e8cd9 tempest-AttachVolumeNegativeTest-2811165 None] attachment_update completed successfully. Jul 23 03:23:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=92,cinder:UPDATE=99,cinder:INSERT=24,cinder:DELETE=9 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=94,cinder:INSERT=24,cinder:UPDATE=125,cinder:DELETE=12 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-b8d530f1-d95f-4ad2-bca8-c996baea75aa req-b4f022c5-c5bb-4914-8c25-5059bc6b3d6a tempest-AttachVolumeNegativeTest-2811165 None] Terminate volume connection completed successfully. Jul 23 03:23:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-b8d530f1-d95f-4ad2-bca8-c996baea75aa req-b4f022c5-c5bb-4914-8c25-5059bc6b3d6a tempest-AttachVolumeNegativeTest-2811165 None] Deleting attachment 9742ed95-1491-4ce0-a84e-43beeee22ab3. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-98c96de4-d925-436a-8a84-dd6c0d435152-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-98c96de4-d925-436a-8a84-dd6c0d435152-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-quobyte-98c96de4-d925-436a-8a84-dd6c0d435152" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-98c96de4-d925-436a-8a84-dd6c0d435152" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5410340-960f-48ac-94f3-6f9820ba2024]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:03 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 Jul 23 03:24:03 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:03 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152" returned: 0 in 0.835s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:03 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152 Jul 23 03:24:03 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:04 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-98c96de4-d925-436a-8a84-dd6c0d435152" returned: 0 in 0.537s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-98c96de4-d925-436a-8a84-dd6c0d435152" released by "delete_volume" :: held 1.521s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Created reservations ['200a2bd1-8be3-46d0-bb25-d2958c6f8585', '79b014f4-cc36-4d76-93eb-3eae35ae2ed0', '85d7bd8e-714d-416d-bf26-006b4bc1ab6f', 'dd301f8d-b1f2-4211-a15f-f4c1d93a2afb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (45b216cd-b81e-427d-ba83-147b82aa2369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf65c384-1ffa-42db-8571-d9bd4de87742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf65c384-1ffa-42db-8571-d9bd4de87742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-439995322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc640c2e-a820-4d4a-8fe7-c9870db7b82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bd938ac17c4cd7a0ae967e99dac553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:05Z,use_quota=True,user_id='2139a46c1a6e4755beed949d1dfa0c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2970471f-64ff-44f1-9634-b9b3eaf72b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2970471f-64ff-44f1-9634-b9b3eaf72b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f4b547-b409-47b8-a365-d968f95a512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f4b547-b409-47b8-a365-d968f95a512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc640c2e-a820-4d4a-8fe7-c9870db7b82f', 'volume_name': 'volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866a4009-c5df-4593-9ee5-dda1720bd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866a4009-c5df-4593-9ee5-dda1720bd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883619c1-2912-4a23-bbc8-b35cfcbd7ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f', 'volume_size': 1} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-439995322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc640c2e-a820-4d4a-8fe7-c9870db7b82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bd938ac17c4cd7a0ae967e99dac553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:05Z,use_quota=True,user_id='2139a46c1a6e4755beed949d1dfa0c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Creating volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:04 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f 1073741824 Jul 23 03:24:04 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:04 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:04 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-2d44a563-db46-4c78-b8b7-864807897e37-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-2d44a563-db46-4c78-b8b7-864807897e37-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-quobyte-2d44a563-db46-4c78-b8b7-864807897e37" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-2d44a563-db46-4c78-b8b7-864807897e37" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2d654-c619-4455-8057-76c101529b17]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:05 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.751s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Deleted volume successfully. Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bff91e4c-7e2b-47c9-9fa9-c4c64df0eeb3 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-98c96de4-d925-436a-8a84-dd6c0d435152-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:05 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 Jul 23 03:24:05 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:05 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f 1073741824" returned: 0 in 1.064s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:06 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:06 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:06 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:06 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37" returned: 0 in 0.741s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883619c1-2912-4a23-bbc8-b35cfcbd7ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6c3cea-394c-4b23-b794-a577a0d9f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:06 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37 Jul 23 03:24:06 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:06 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Volume volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f (cc640c2e-a820-4d4a-8fe7-c9870db7b82f): created successfully Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6c3cea-394c-4b23-b794-a577a0d9f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (45b216cd-b81e-427d-ba83-147b82aa2369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-997513e9-47da-4633-9e85-e7933fad3b6c tempest-VolumesDeleteCascade-1989057230 None] Created volume successfully. Jul 23 03:24:06 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d44a563-db46-4c78-b8b7-864807897e37" returned: 0 in 0.430s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-2d44a563-db46-4c78-b8b7-864807897e37" released by "delete_volume" :: held 1.270s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:06 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Created reservations ['a20cbe66-e123-433c-99ad-c83a262d125c', '8c35199c-ccd4-4ff9-8af0-3e9cc314526e', '0635e1eb-931b-4785-926a-2758642cb061', 'd3145554-658b-4181-8171-79e728cb1221'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Creating offline snapshot 6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 of volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25fa8b7-a32f-4a2c-a9e6-a3eac45c5598]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:07 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:07 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:07 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:07 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:07 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.342s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Deleted volume successfully. Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-00cea1f3-b2be-45f4-8b0b-b5afe30a1ac8 tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-2d44a563-db46-4c78-b8b7-864807897e37-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:07 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.516s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:07 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 1G Jul 23 03:24:07 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-eefda3dd-21cd-466f-aea8-916d2d900745-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-eefda3dd-21cd-466f-aea8-916d2d900745-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "cinder-quobyte-eefda3dd-21cd-466f-aea8-916d2d900745" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-eefda3dd-21cd-466f-aea8-916d2d900745" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b310e39-1623-40d3-90b2-bf133836b7ad]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 Jul 23 03:24:08 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 1G" returned: 0 in 0.612s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:08 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745" returned: 0 in 0.507s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745 Jul 23 03:24:08 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:08 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 is being set with open permissions: ugo+rw Jul 23 03:24:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:08 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:09 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-eefda3dd-21cd-466f-aea8-916d2d900745" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-quobyte-eefda3dd-21cd-466f-aea8-916d2d900745" released by "delete_volume" :: held 0.844s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:09 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Created reservations ['ce10a10e-504b-42c7-a883-5dfcec684aa9', 'c436f6a8-f7e4-4d4c-921c-ae359efbb712', '1490ac77-cee4-4497-9b60-9dda1d9d7e05', '9d280d87-c9df-4906-a255-e4b637efe6ee'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:09 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info Jul 23 03:24:09 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:09 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:09 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:09 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info" returned: 0 in 0.439s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info is being set with open permissions: ugo+rw Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:09 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.341s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info Jul 23 03:24:09 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:09 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Deleted volume successfully. Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1211392e-1ac6-40b4-ac4a-78cc7d167fdd tempest-AttachVolumeNegativeTest-2811165 None] Lock "cinder-eefda3dd-21cd-466f-aea8-916d2d900745-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:09 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.info" returned: 0 in 0.355s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-93b6ba4a-c2f6-4ba7-8c77-5591eeaecb04 tempest-VolumesDeleteCascade-1989057230 None] Create snapshot completed successfully Jul 23 03:24:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Creating offline snapshot 751eb348-37f2-488a-97e8-2649021a0c7b of volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:24:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dcdead-10b3-4b5b-90cf-d44081bad764]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:10 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:10 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:11 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.514s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:11 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b 1G Jul 23 03:24:11 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:11 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b 1G" returned: 0 in 0.636s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:11 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:11 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:12 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 0.458s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:12 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b is being set with open permissions: ugo+rw Jul 23 03:24:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:12 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:12 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:12 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 0.305s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-66b8e287-1bc9-43e9-a966-1c0d7d88c4ba tempest-VolumesDeleteCascade-1989057230 None] Create snapshot completed successfully Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-cc640c2e-a820-4d4a-8fe7-c9870db7b82f-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-cc640c2e-a820-4d4a-8fe7-c9870db7b82f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Performing cascade delete. {{(pid=88466) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Deleting offline snapshot 6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 of volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] snapshot_file for this snap is: volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[51279f11-c486-4743-b74a-89bbe1a54878]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:14 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:14 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:14 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.498s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5f7595-a285-4f0f-a4e0-d386bc6b4b83]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:14 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:14 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:15 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.646s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3ffd7-157e-4352-95c7-d98e998d8a6d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:15 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:15 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:15 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 0.543s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c28d59-174c-4cf9-ad20-50dc4a9dcd07]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:16 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:16 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:16 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.694s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd8bf5d-bfdc-45b4-9ff1-8b7e2c6d77b7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:16 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:16 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:17 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.497s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:17 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:17 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:17 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.561s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:17 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912 Jul 23 03:24:17 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:18 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" returned: 0 in 0.411s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b -F qcow2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:18 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b -F qcow2 Jul 23 03:24:18 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Acquiring lock "cinder-43302248-3889-486d-9d4a-bd3c85377b13-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "cinder-43302248-3889-486d-9d4a-bd3c85377b13-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Acquiring lock "cinder-quobyte-43302248-3889-486d-9d4a-bd3c85377b13" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "cinder-quobyte-43302248-3889-486d-9d4a-bd3c85377b13" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a013d48-a74c-403a-b3b5-ecdc4f990db8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:18 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 Jul 23 03:24:18 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:18 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b -F qcow2" returned: 0 in 0.491s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912" released by "_delete_snapshot" :: held 4.628s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" released by "delete_snapshot" :: held 4.678s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['6a873bf2-21f9-46ab-a8eb-bc5f14e9ad4f', '467381a5-a2d1-4cbc-9ad5-40efcac594cf', 'd397c1aa-02ce-48b2-a836-0cf7a63a6108', '6e1c0951-65f2-4c91-a329-e62b19f8de1f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Delete snapshot completed successfully. Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-6bc0838a-d8c0-4c43-a7f5-ed4d34a87912-delete_snapshot" released by "delete_snapshot" :: held 4.892s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-751eb348-37f2-488a-97e8-2649021a0c7b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:18 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13" returned: 0 in 0.512s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-751eb348-37f2-488a-97e8-2649021a0c7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:18 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13 Jul 23 03:24:18 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-751eb348-37f2-488a-97e8-2649021a0c7b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-751eb348-37f2-488a-97e8-2649021a0c7b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Deleting offline snapshot 751eb348-37f2-488a-97e8-2649021a0c7b of volume cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] snapshot_file for this snap is: volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cd396-b82c-4f8b-9574-92b78d623dee]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:19 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-43302248-3889-486d-9d4a-bd3c85377b13" returned: 0 in 0.662s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "cinder-quobyte-43302248-3889-486d-9d4a-bd3c85377b13" released by "delete_volume" :: held 1.268s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:19 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:19 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Created reservations ['3b3a3d78-cd8c-448d-8d45-81398d0d4002', '12186e72-c9d2-4108-b8ee-c43e600ef820', '8ffc26cf-3e50-476b-b86c-731948b1862b', '4548659c-ff5b-47b4-921a-1a9f4bc3b6e7'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:19 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:19 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Flow 'volume_create_manager' (8501381c-121c-46ec-b967-257939f9d19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49875b9d-c5f2-470c-a2f4-af41044cbb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49875b9d-c5f2-470c-a2f4-af41044cbb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1190097679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7faee16e-47ff-4b40-a734-63db38dc137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3455ca3c750b4ababa9beaa853d58000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:20Z,use_quota=True,user_id='f7d8ca7e4205466d8e0bb33a87bdf787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf4ec2-0f7e-4fdd-88a1-3f6479fb2d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf4ec2-0f7e-4fdd-88a1-3f6479fb2d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc07cc7b-d448-4302-a212-6d54bf83a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc07cc7b-d448-4302-a212-6d54bf83a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7faee16e-47ff-4b40-a734-63db38dc137c', 'volume_name': 'volume-7faee16e-47ff-4b40-a734-63db38dc137c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a9ae19-ae77-404e-8bf4-280f7652083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a9ae19-ae77-404e-8bf4-280f7652083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c8acd-7d97-4619-b4c3-d8c527e30809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Volume 7faee16e-47ff-4b40-a734-63db38dc137c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7faee16e-47ff-4b40-a734-63db38dc137c', 'volume_size': 1} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1190097679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7faee16e-47ff-4b40-a734-63db38dc137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3455ca3c750b4ababa9beaa853d58000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:20Z,use_quota=True,user_id='f7d8ca7e4205466d8e0bb33a87bdf787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Creating volume 7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:20 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:20 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c 1073741824 Jul 23 03:24:20 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:20 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 1.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd77ea1e-b1ce-43e5-a76e-1b76f1ad7bed]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:20 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.523s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Deleted volume successfully. Jul 23 03:24:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8bb30a99-d110-45f9-8345-e7d8d2d33563 tempest-VolumesNegativeTest-495302352 None] Lock "cinder-43302248-3889-486d-9d4a-bd3c85377b13-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:20 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:20 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:21 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c 1073741824" returned: 0 in 0.848s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:21 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.731s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:21 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:21 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:21 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c Jul 23 03:24:21 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:21 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 0.514s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:21 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b Jul 23 03:24:21 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:21 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c" returned: 0 in 0.435s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c8acd-7d97-4619-b4c3-d8c527e30809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7faee16e-47ff-4b40-a734-63db38dc137c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2af1f7-8bfa-4c4d-81a9-b4f690743574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:21 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Volume volume-7faee16e-47ff-4b40-a734-63db38dc137c (7faee16e-47ff-4b40-a734-63db38dc137c): created successfully Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2af1f7-8bfa-4c4d-81a9-b4f690743574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Flow 'volume_create_manager' (8501381c-121c-46ec-b967-257939f9d19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:21 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-10bdc49d-94f6-4e89-9dfc-b7082129bace req-cc3f40ff-76a6-462b-b634-b4704bea87ba tempest-VolumesSnapshotsTestJSON-197191951 None] Created volume successfully. Jul 23 03:24:21 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f.751eb348-37f2-488a-97e8-2649021a0c7b" returned: 0 in 0.311s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-751eb348-37f2-488a-97e8-2649021a0c7b" released by "_delete_snapshot" :: held 2.997s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" released by "delete_snapshot" :: held 3.034s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['e5894171-bf92-4354-956d-6c511da27749', '78d066f9-e391-4492-9fc7-155eda4bf1cc', '7b789632-2dbb-49a8-83fd-7bebfe405d66', '3093d9d7-12ad-48fd-a7ac-d5da4ab0a1fc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Delete snapshot completed successfully. Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-751eb348-37f2-488a-97e8-2649021a0c7b-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Snapshots deleted, issuing volume delete {{(pid=88466) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b73bf7-93c5-4beb-9fb0-b81bef506563]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:22 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:22 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:23 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.861s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:23 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f Jul 23 03:24:23 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Creating offline snapshot a60880af-8bb6-4494-8793-0aee5d414074 of volume 7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405f4e0-fdef-4bb9-937b-2353b2728f82]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:23 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c Jul 23 03:24:23 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:24 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" returned: 0 in 0.965s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-cc640c2e-a820-4d4a-8fe7-c9870db7b82f" released by "delete_volume" :: held 1.957s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['99bd42d1-07d8-4e6b-825e-4c7e529222ae', '1330cc8e-6918-401e-b352-db7b89c258a4', 'cdd381d6-1daa-4a34-b401-c12df4abd38e', '814e7bec-e823-4908-8c46-5d5d2f89fb76'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:24 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c" returned: 0 in 0.917s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:24 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 1G Jul 23 03:24:24 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:24 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:24 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:25 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.657s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Deleted volume successfully. Jul 23 03:24:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3eccf1ec-553f-410f-a328-3f0f9af3b24f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-cc640c2e-a820-4d4a-8fe7-c9870db7b82f-delete_volume" released by "delete_volume" :: held 11.429s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:25 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 1G" returned: 0 in 0.957s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7faee16e-47ff-4b40-a734-63db38dc137c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:25 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7faee16e-47ff-4b40-a734-63db38dc137c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 Jul 23 03:24:25 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:26 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7faee16e-47ff-4b40-a734-63db38dc137c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074" returned: 0 in 0.680s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:26 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 is being set with open permissions: ugo+rw Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:26 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 Jul 23 03:24:26 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:26 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074" returned: 0 in 0.669s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (01e3f0ca-2da2-48b8-8eef-cf51192d61b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff7e62a-a696-4f29-99ae-9bf90c7c40d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff7e62a-a696-4f29-99ae-9bf90c7c40d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81103915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e53e87-f24f-43a5-a3f7-07c3727d0a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bd938ac17c4cd7a0ae967e99dac553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:27Z,use_quota=True,user_id='2139a46c1a6e4755beed949d1dfa0c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32918b8-cb4f-4ce5-988d-2dc54aba55ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32918b8-cb4f-4ce5-988d-2dc54aba55ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821fade-7623-4786-87fd-cfbb412b18b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821fade-7623-4786-87fd-cfbb412b18b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e53e87-f24f-43a5-a3f7-07c3727d0a61', 'volume_name': 'volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3a8a6b-81f9-457f-a1b8-63efe0a3285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3a8a6b-81f9-457f-a1b8-63efe0a3285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c8055b-4520-42e7-99b5-f08b99113aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:26 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Volume d0e53e87-f24f-43a5-a3f7-07c3727d0a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61', 'volume_size': 1} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:26 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info Jul 23 03:24:26 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info" returned: 0 in 0.473s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info is being set with open permissions: ugo+rw Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info Jul 23 03:24:27 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.info" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-81103915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e53e87-f24f-43a5-a3f7-07c3727d0a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bd938ac17c4cd7a0ae967e99dac553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:27Z,use_quota=True,user_id='2139a46c1a6e4755beed949d1dfa0c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Creating volume d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:27 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:24:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 1073741824 Jul 23 03:24:27 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-b0bf687f-7991-488f-a698-c627e5202595 req-1a761049-044e-4650-8aae-4cfcc084f627 tempest-VolumesSnapshotsTestJSON-197191951 None] Create snapshot completed successfully Jul 23 03:24:28 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 1073741824" returned: 0 in 0.613s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:28 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "cinder-a60880af-8bb6-4494-8793-0aee5d414074-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-a60880af-8bb6-4494-8793-0aee5d414074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "cinder-quobyte-a60880af-8bb6-4494-8793-0aee5d414074" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-a60880af-8bb6-4494-8793-0aee5d414074" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Deleting offline snapshot a60880af-8bb6-4494-8793-0aee5d414074 of volume 7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] snapshot_file for this snap is: volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b982c7fd-6804-49c3-8d2c-edb66192a4da]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 Jul 23 03:24:28 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.481s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c8055b-4520-42e7-99b5-f08b99113aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571678cc-15f1-4dec-9022-322b92c78722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:28 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Volume volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 (d0e53e87-f24f-43a5-a3f7-07c3727d0a61): created successfully Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571678cc-15f1-4dec-9022-322b92c78722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (01e3f0ca-2da2-48b8-8eef-cf51192d61b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41f1fe71-c141-4b42-83fe-a2841c51aaeb tempest-VolumesDeleteCascade-1989057230 None] Created volume successfully. Jul 23 03:24:29 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074" returned: 0 in 0.489s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7faee16e-47ff-4b40-a734-63db38dc137c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a80d6b-456c-4757-b12f-88d4b242987c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:29 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c Jul 23 03:24:29 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:29 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:29 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 Jul 23 03:24:29 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Creating offline snapshot c808dd76-3c3a-445d-892d-51c29287cb8b of volume d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[72641739-2f16-493c-a0f2-4b09a9634400]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:30 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074" returned: 0 in 0.599s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:30 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074 Jul 23 03:24:30 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:30 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c.a60880af-8bb6-4494-8793-0aee5d414074" returned: 0 in 0.321s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-a60880af-8bb6-4494-8793-0aee5d414074" released by "_delete_snapshot" :: held 1.981s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" released by "delete_snapshot" :: held 2.030s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.quota [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Created reservations ['980de9f3-4322-46cf-b133-4c3363fa52f3', 'd430578b-f891-436a-9c86-26a9ef0fd790', 'c911f8d6-37ec-4fa0-a4de-74b0370f117a', 'd5b36ef1-6026-4b93-9444-0708e5afc319'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:30 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.582s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:30 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b 1G Jul 23 03:24:30 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Delete snapshot completed successfully. Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-1f333773-074b-4d0b-9676-f13212c6269a req-f26c56e1-4cee-48a7-b0d9-a37b90167ec8 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-a60880af-8bb6-4494-8793-0aee5d414074-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "cinder-7faee16e-47ff-4b40-a734-63db38dc137c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-7faee16e-47ff-4b40-a734-63db38dc137c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6384d111-fa2c-4cf8-8843-201c4965ebde]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c Jul 23 03:24:31 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b 1G" returned: 0 in 0.645s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:31 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c" returned: 0 in 0.464s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c Jul 23 03:24:31 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.534s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b is being set with open permissions: ugo+rw Jul 23 03:24:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:32 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7faee16e-47ff-4b40-a734-63db38dc137c" returned: 0 in 0.561s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-quobyte-7faee16e-47ff-4b40-a734-63db38dc137c" released by "delete_volume" :: held 1.197s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG cinder.quota [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Created reservations ['1f156938-ad15-43d2-aac8-16ebd9bb3762', 'fc8415ad-e092-46f8-be93-badec70368e1', '51ab9771-33e4-477e-b675-ab0cc16a7d76', 'd04497b4-e6fd-4abf-b52e-21ae75c027f5'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:32 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.476s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:32 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info Jul 23 03:24:32 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info" returned: 0 in 0.344s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info is being set with open permissions: ugo+rw Jul 23 03:24:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info Jul 23 03:24:32 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:33 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.543s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:33 devstack cinder-volume[88466]: DEBUG cinder.manager [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Deleted volume successfully. Jul 23 03:24:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-733d7640-5cd9-42bd-a7b6-ccd3cd2832f7 req-2b2b4e41-66fc-4437-8510-31a187058526 tempest-VolumesSnapshotsTestJSON-197191951 None] Lock "cinder-7faee16e-47ff-4b40-a734-63db38dc137c-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:33 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.info" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c05a5814-3901-4d71-bb46-028aa0b3a268 tempest-VolumesDeleteCascade-1989057230 None] Create snapshot completed successfully Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (4649928b-4a97-4bf6-90a1-5c1624b0796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4677e6-033e-4e44-9292-edeeb590e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4677e6-033e-4e44-9292-edeeb590e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-695436153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d73de-aa40-4537-a09d-a7112a86d577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bd938ac17c4cd7a0ae967e99dac553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c808dd76-3c3a-445d-892d-51c29287cb8b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:35Z,use_quota=True,user_id='2139a46c1a6e4755beed949d1dfa0c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3697b3ad-8a98-48bd-bf09-f0e6cb9b67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3697b3ad-8a98-48bd-bf09-f0e6cb9b67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd830e54-bf03-4595-a04f-fccd0e72bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd830e54-bf03-4595-a04f-fccd0e72bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e9d73de-aa40-4537-a09d-a7112a86d577', 'volume_name': 'volume-4e9d73de-aa40-4537-a09d-a7112a86d577', 'volume_size': 1, 'snapshot_id': 'c808dd76-3c3a-445d-892d-51c29287cb8b'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d4b5b6-b575-4f0e-bb92-5baef9374d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d4b5b6-b575-4f0e-bb92-5baef9374d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee2773-8fd0-4e1f-9260-1b5dd2e333ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Volume 4e9d73de-aa40-4537-a09d-a7112a86d577: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e9d73de-aa40-4537-a09d-a7112a86d577', 'volume_size': 1, 'snapshot_id': 'c808dd76-3c3a-445d-892d-51c29287cb8b'} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b-4e9d73de-aa40-4537-a09d-a7112a86d577" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b-4e9d73de-aa40-4537-a09d-a7112a86d577" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Creating volume 4e9d73de-aa40-4537-a09d-a7112a86d577 from snapshot c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] snapshot: c808dd76-3c3a-445d-892d-51c29287cb8b, volume: 4e9d73de-aa40-4537-a09d-a7112a86d577, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c544424-d668-43f7-a6e2-c18cc34d0b30]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:35 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:35 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:36 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.461s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[db29a4a3-e548-4054-9c77-233dca7d5974]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:36 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:36 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:36 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.466s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:24:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:36 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 Jul 23 03:24:36 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:42 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577" returned: 0 in 5.965s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2894cb-5f8f-4d22-bd00-c7f652fa4f60]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:42 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:42 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:43 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.705s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:24:43 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Converted 1024.00 MB image at 171.64 MB/s Jul 23 03:24:43 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 is being set with open permissions: ugo+rw Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:43 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 Jul 23 03:24:43 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:43 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577" returned: 0 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" released by "_copy_volume_from_snapshot" :: held 8.122s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b-4e9d73de-aa40-4537-a09d-a7112a86d577" released by "_create_volume_from_snapshot" :: held 8.175s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.200s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee2773-8fd0-4e1f-9260-1b5dd2e333ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9d73de-aa40-4537-a09d-a7112a86d577', 'volume_size': 1, 'snapshot_id': 'c808dd76-3c3a-445d-892d-51c29287cb8b'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e01ad-5f56-433a-8f66-b4eff7864d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Volume volume-4e9d73de-aa40-4537-a09d-a7112a86d577 (4e9d73de-aa40-4537-a09d-a7112a86d577): created successfully Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e01ad-5f56-433a-8f66-b4eff7864d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Flow 'volume_create_manager' (4649928b-4a97-4bf6-90a1-5c1624b0796b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a9b3123a-0312-4527-a9b9-372ff100229b tempest-VolumesDeleteCascade-1989057230 None] Created volume successfully. Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-d0e53e87-f24f-43a5-a3f7-07c3727d0a61-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-d0e53e87-f24f-43a5-a3f7-07c3727d0a61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Performing cascade delete. {{(pid=88466) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-c808dd76-3c3a-445d-892d-51c29287cb8b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-c808dd76-3c3a-445d-892d-51c29287cb8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Deleting offline snapshot c808dd76-3c3a-445d-892d-51c29287cb8b of volume d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] snapshot_file for this snap is: volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37def4-2671-4fe4-9cff-7b87edbf4c7c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:44 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:44 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.406s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c10d22-be1a-49e6-a5d7-db55d0de157f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:45 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:45 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:45 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.523s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:45 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:45 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:46 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:46 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b Jul 23 03:24:46 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:46 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61.c808dd76-3c3a-445d-892d-51c29287cb8b" returned: 0 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-c808dd76-3c3a-445d-892d-51c29287cb8b" released by "_delete_snapshot" :: held 1.904s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" released by "delete_snapshot" :: held 1.933s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['4e7e10e2-cc8a-4e28-bb6f-2bdff4e7b228', 'a4f76d21-faf4-441d-a71e-f5e19272ad44', '94d5e20b-87fc-41d8-9357-c9564184577c', 'a9f71054-9909-4b10-8ddc-247849f4d942'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Delete snapshot completed successfully. Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-c808dd76-3c3a-445d-892d-51c29287cb8b-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Snapshots deleted, issuing volume delete {{(pid=88466) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5463e28d-4f8f-4048-9c0d-2738aad3738c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:46 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:46 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:47 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.673s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:47 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61 Jul 23 03:24:47 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:47 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" returned: 0 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:47 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:47 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-d0e53e87-f24f-43a5-a3f7-07c3727d0a61" released by "delete_volume" :: held 1.200s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['89137658-232e-4b81-89f1-9187a4405da3', '43dd690f-1b8a-445a-93f8-bb432d8dbe3e', 'b747fad0-9bc4-4146-8019-3412adac108e', '8bfadf05-ebe7-4fb0-a93d-58067a938c43'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:48 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.383s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (666c7b7f-e587-4eac-b01f-6d61866383c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86c6ca8-8124-43d1-8f0b-d0e8eaa8ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86c6ca8-8124-43d1-8f0b-d0e8eaa8ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-341419796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a095268e-3e4d-43a5-a4d4-1a0a8530db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:48Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a672bfc-4e73-4d02-989a-4115ba3113a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a672bfc-4e73-4d02-989a-4115ba3113a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a75158-48d9-43af-bc80-eda323a07606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a75158-48d9-43af-bc80-eda323a07606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a095268e-3e4d-43a5-a4d4-1a0a8530db69', 'volume_name': 'volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a7ce32-2b3a-4ff0-aecf-2d6bdb81ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a7ce32-2b3a-4ff0-aecf-2d6bdb81ad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccf3094-05d8-4581-9413-3d9bdacfde46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:48 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Volume a095268e-3e4d-43a5-a4d4-1a0a8530db69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69', 'volume_size': 1} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-341419796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a095268e-3e4d-43a5-a4d4-1a0a8530db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:48Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Creating volume a095268e-3e4d-43a5-a4d4-1a0a8530db69 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:48 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:48 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 1073741824 Jul 23 03:24:48 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:48 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Deleted volume successfully. Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c673a49a-2ef9-484e-8a56-2c16dd3ccae2 tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-d0e53e87-f24f-43a5-a3f7-07c3727d0a61-delete_volume" released by "delete_volume" :: held 4.457s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:48 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 1073741824" returned: 0 in 0.576s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 Jul 23 03:24:48 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-4e9d73de-aa40-4537-a09d-a7112a86d577-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-4e9d73de-aa40-4537-a09d-a7112a86d577-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:49 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccf3094-05d8-4581-9413-3d9bdacfde46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e948e3-a18a-4674-819c-3b1bf1506c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Volume volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 (a095268e-3e4d-43a5-a4d4-1a0a8530db69): created successfully Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e948e3-a18a-4674-819c-3b1bf1506c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (666c7b7f-e587-4eac-b01f-6d61866383c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b2a84c-0c00-4cc3-b9bf-76cfbb36e1ab]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c9ca6b31-bbc6-4bec-ab68-396672214013 tempest-AttachVolumeTestJSON-1770636334 None] Created volume successfully. Jul 23 03:24:49 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 Jul 23 03:24:49 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577" returned: 0 in 0.461s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577 Jul 23 03:24:49 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:50 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4e9d73de-aa40-4537-a09d-a7112a86d577" returned: 0 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-quobyte-4e9d73de-aa40-4537-a09d-a7112a86d577" released by "delete_volume" :: held 0.931s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Created reservations ['72f5781e-8786-4fa4-9029-ea835bf5fc7f', '01e41d30-b315-4ee1-8114-97704aac2b09', 'a040fe1c-5133-440e-9422-7eeb30ece4d8', '6d302836-c207-4d52-8a1c-2fc36f125069'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:50 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:24:50 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.505s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Deleted volume successfully. Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-047e2a6a-a57a-4a66-b89d-f484a77c450f tempest-VolumesDeleteCascade-1989057230 None] Lock "cinder-4e9d73de-aa40-4537-a09d-a7112a86d577-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-884d3853-9a66-4b2c-a52f-46ee04fea807 req-a8baef0d-a0e7-4159-8820-ced0405e686c tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-884d3853-9a66-4b2c-a52f-46ee04fea807 req-a8baef0d-a0e7-4159-8820-ced0405e686c tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-884d3853-9a66-4b2c-a52f-46ee04fea807 req-a8baef0d-a0e7-4159-8820-ced0405e686c tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-884d3853-9a66-4b2c-a52f-46ee04fea807 req-a8baef0d-a0e7-4159-8820-ced0405e686c tempest-AttachVolumeTestJSON-1770636334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5b82be3-cffe-4fc3-b681-30805e88c5aa', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:24:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-884d3853-9a66-4b2c-a52f-46ee04fea807 req-a8baef0d-a0e7-4159-8820-ced0405e686c tempest-AttachVolumeTestJSON-1770636334 None] attachment_update completed successfully. Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (e8b0fe95-5328-4341-8f35-e218142ff1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332bdec-cf21-4887-856c-f33915bf0b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332bdec-cf21-4887-856c-f33915bf0b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-794258048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d54fe4-f3c3-4291-b1a7-12ebebe3c734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:54Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03b81b2-a29c-4508-bedc-7402ce112d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03b81b2-a29c-4508-bedc-7402ce112d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8d77cd-1cef-417f-bd65-5b3c2936860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8d77cd-1cef-417f-bd65-5b3c2936860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d54fe4-f3c3-4291-b1a7-12ebebe3c734', 'volume_name': 'volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366e5f65-09ba-4fda-b098-159a1142f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366e5f65-09ba-4fda-b098-159a1142f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068295f3-701d-4e9b-bd26-42e9f822e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Volume 49d54fe4-f3c3-4291-b1a7-12ebebe3c734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734', 'volume_size': 1} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-794258048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d54fe4-f3c3-4291-b1a7-12ebebe3c734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1281b204a08c4c7cbe7ad99d01f66669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:54Z,use_quota=True,user_id='7313fe97dd1f457eb5c87228d3c60c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Creating volume 49d54fe4-f3c3-4291-b1a7-12ebebe3c734 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:54 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:24:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:54 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 1073741824 Jul 23 03:24:54 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:55 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 1073741824" returned: 0 in 0.553s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:55 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 Jul 23 03:24:55 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:55 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" returned: 0 in 0.307s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=97,cinder:INSERT=33,cinder:UPDATE=101,cinder:DELETE=9 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068295f3-701d-4e9b-bd26-42e9f822e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2eca892-834d-4987-8b61-e628c0bffaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=119,cinder:SELECT=91,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Volume volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 (49d54fe4-f3c3-4291-b1a7-12ebebe3c734): created successfully Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2eca892-834d-4987-8b61-e628c0bffaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Flow 'volume_create_manager' (e8b0fe95-5328-4341-8f35-e218142ff1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-32efc8cf-4d31-4a1c-bb42-4a981c9fcaa9 tempest-AttachVolumeTestJSON-1770636334 None] Created volume successfully. Jul 23 03:24:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-5acfc830-82c1-4eaa-87c3-14656ac5edf9 req-1266637e-bafd-45e1-a940-cab1366913ec tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-5acfc830-82c1-4eaa-87c3-14656ac5edf9 req-1266637e-bafd-45e1-a940-cab1366913ec tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-5acfc830-82c1-4eaa-87c3-14656ac5edf9 req-1266637e-bafd-45e1-a940-cab1366913ec tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-5acfc830-82c1-4eaa-87c3-14656ac5edf9 req-1266637e-bafd-45e1-a940-cab1366913ec tempest-AttachVolumeTestJSON-1770636334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70a9dbfe-88b4-4434-bcb8-d544873ef966', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:24:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-5acfc830-82c1-4eaa-87c3-14656ac5edf9 req-1266637e-bafd-45e1-a940-cab1366913ec tempest-AttachVolumeTestJSON-1770636334 None] attachment_update completed successfully. Jul 23 03:25:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-4b98548e-c072-4d95-b3e2-8d65738a3035 req-b978a6f7-bbae-498b-96cb-b5a10a80d638 tempest-AttachVolumeTestJSON-1770636334 None] Terminate volume connection completed successfully. Jul 23 03:25:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-4b98548e-c072-4d95-b3e2-8d65738a3035 req-b978a6f7-bbae-498b-96cb-b5a10a80d638 tempest-AttachVolumeTestJSON-1770636334 None] Deleting attachment f5b82be3-cffe-4fc3-b681-30805e88c5aa. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:25:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-e017a8d6-a275-43da-9724-2bb657e86f26 req-4ddbc8a3-8291-4cd7-b138-39a99019f25e tempest-AttachVolumeTestJSON-1770636334 None] Terminate volume connection completed successfully. Jul 23 03:25:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-e017a8d6-a275-43da-9724-2bb657e86f26 req-4ddbc8a3-8291-4cd7-b138-39a99019f25e tempest-AttachVolumeTestJSON-1770636334 None] Deleting attachment 70a9dbfe-88b4-4434-bcb8-d544873ef966. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Flow 'volume_create_manager' (383ee5de-a502-477e-a311-6b86b12db731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7039253-cf4e-4e20-b81d-f7b170a57ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7039253-cf4e-4e20-b81d-f7b170a57ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-732857990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f053a2e-9e88-4cef-9b5d-a028574e2537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8073d01848c14fa0afa2882c917ec6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:09Z,use_quota=True,user_id='afcbe13440f14b00aa6db7d6ab86ffcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbee661-cc98-48c0-9f9e-0afe7ce4c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbee661-cc98-48c0-9f9e-0afe7ce4c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2f9e3-3d64-4458-a576-fc98d352e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2f9e3-3d64-4458-a576-fc98d352e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f053a2e-9e88-4cef-9b5d-a028574e2537', 'volume_name': 'volume-1f053a2e-9e88-4cef-9b5d-a028574e2537', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be6ded5-e56b-4d2a-b4af-f495dd5cf9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be6ded5-e56b-4d2a-b4af-f495dd5cf9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58363e29-ee33-4837-8f74-24b9061b5e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Volume 1f053a2e-9e88-4cef-9b5d-a028574e2537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f053a2e-9e88-4cef-9b5d-a028574e2537', 'volume_size': 1} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-732857990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f053a2e-9e88-4cef-9b5d-a028574e2537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8073d01848c14fa0afa2882c917ec6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:09Z,use_quota=True,user_id='afcbe13440f14b00aa6db7d6ab86ffcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Creating volume 1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:09 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:25:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:09 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 1073741824 Jul 23 03:25:09 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:10 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 1073741824" returned: 0 in 1.119s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:10 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:25:10 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:10 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.334s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58363e29-ee33-4837-8f74-24b9061b5e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f053a2e-9e88-4cef-9b5d-a028574e2537', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ede2729-eccb-41c6-9623-312590a6edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Volume volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 (1f053a2e-9e88-4cef-9b5d-a028574e2537): created successfully Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ede2729-eccb-41c6-9623-312590a6edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Flow 'volume_create_manager' (383ee5de-a502-477e-a311-6b86b12db731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4adfceb3-1d83-4fed-85b8-b9bb567c4f34 tempest-VolumesActionsTest-789206733 None] Created volume successfully. Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-49d54fe4-f3c3-4291-b1a7-12ebebe3c734-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-49d54fe4-f3c3-4291-b1a7-12ebebe3c734-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-quobyte-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c331d9-a425-4c9e-b30f-dbb473e9ac86]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:12 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 Jul 23 03:25:12 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:12 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" returned: 0 in 0.602s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:12 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734 Jul 23 03:25:12 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:13 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" returned: 0 in 0.590s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-49d54fe4-f3c3-4291-b1a7-12ebebe3c734" released by "delete_volume" :: held 1.240s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Created reservations ['440fbd01-e144-4d6a-a93b-f32654c07a22', '0a8d5f2d-1edd-447c-935e-7c6d70abd985', '1ba79e74-110d-495d-b8bc-32d0450cd703', '246d36dc-e7e2-46e3-8ff6-1439acbf2e96'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:13 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:13 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:14 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.394s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Deleted volume successfully. Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5456f20b-ed16-472c-b7b9-f04418adee61 tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-49d54fe4-f3c3-4291-b1a7-12ebebe3c734-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-a095268e-3e4d-43a5-a4d4-1a0a8530db69-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-a095268e-3e4d-43a5-a4d4-1a0a8530db69-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-quobyte-a095268e-3e4d-43a5-a4d4-1a0a8530db69" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-a095268e-3e4d-43a5-a4d4-1a0a8530db69" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95d813-aaad-43dc-8114-e9bbf1d7b21c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:15 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 Jul 23 03:25:15 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:15 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69" returned: 0 in 0.645s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:15 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69 Jul 23 03:25:15 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:15 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Flow 'volume_create_manager' (40843123-4e65-4427-bae9-2c6bb181016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e87bc3-0351-4f6b-84bc-453547b98b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e87bc3-0351-4f6b-84bc-453547b98b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-12996662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151dd34a-7515-46a4-8d02-36251c88cfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c007e31194044c5d8bd26def573a3351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:16Z,use_quota=True,user_id='cf19838ffa5c4c58bbb2cd198ce76044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485a4fd0-b285-40b8-b9ed-3fa20fc90d11),volume_type_id=485a4fd0-b285-40b8-b9ed-3fa20fc90d11)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ff5452-5762-4b4d-9947-c56ac3b0a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ff5452-5762-4b4d-9947-c56ac3b0a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4efbf3-b597-41ef-ace5-439eeb99bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4efbf3-b597-41ef-ace5-439eeb99bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151dd34a-7515-46a4-8d02-36251c88cfb6', 'volume_name': 'volume-151dd34a-7515-46a4-8d02-36251c88cfb6', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e422351d-40c2-424e-ac38-838bd57fcebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e422351d-40c2-424e-ac38-838bd57fcebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e471ff9a-4756-4e92-b7e5-3e526ddad36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Volume 151dd34a-7515-46a4-8d02-36251c88cfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151dd34a-7515-46a4-8d02-36251c88cfb6', 'volume_size': 1} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-12996662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151dd34a-7515-46a4-8d02-36251c88cfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c007e31194044c5d8bd26def573a3351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:16Z,use_quota=True,user_id='cf19838ffa5c4c58bbb2cd198ce76044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(485a4fd0-b285-40b8-b9ed-3fa20fc90d11),volume_type_id=485a4fd0-b285-40b8-b9ed-3fa20fc90d11)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Creating volume 151dd34a-7515-46a4-8d02-36251c88cfb6 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:16 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:16 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 1073741824 Jul 23 03:25:16 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:16 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a095268e-3e4d-43a5-a4d4-1a0a8530db69" returned: 0 in 0.650s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-a095268e-3e4d-43a5-a4d4-1a0a8530db69" released by "delete_volume" :: held 1.399s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Created reservations ['baf78cbc-89e8-4da6-8e1e-0b7187e07490', '7bf28506-ee74-4118-8bed-0b0780f0ebd3', 'cbaf53f8-eec9-4fcb-bac0-1389d12b45e0', 'fa49a435-0196-441f-8b03-b898230414c4'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:16 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:16 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:16 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.363s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Deleted volume successfully. Jul 23 03:25:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2f7a694-43ec-4ad0-bb61-4312cbed142e tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-a095268e-3e4d-43a5-a4d4-1a0a8530db69-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:17 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 1073741824" returned: 0 in 0.880s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 Jul 23 03:25:17 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-63a4f293-b365-4493-9ec4-332f537d73ac-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-63a4f293-b365-4493-9ec4-332f537d73ac-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "cinder-quobyte-63a4f293-b365-4493-9ec4-332f537d73ac" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-63a4f293-b365-4493-9ec4-332f537d73ac" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d15b809-f87b-4999-8da4-f3bebdd84e82]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6" returned: 0 in 0.517s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:17 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac Jul 23 03:25:17 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e471ff9a-4756-4e92-b7e5-3e526ddad36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151dd34a-7515-46a4-8d02-36251c88cfb6', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aded8e3-fb6f-4e74-8b36-4bd0fb735e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Volume volume-151dd34a-7515-46a4-8d02-36251c88cfb6 (151dd34a-7515-46a4-8d02-36251c88cfb6): created successfully Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aded8e3-fb6f-4e74-8b36-4bd0fb735e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Flow 'volume_create_manager' (40843123-4e65-4427-bae9-2c6bb181016d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41d9a38f-739b-4e5b-9e55-0d8ab9dc961c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Created volume successfully. Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Flow 'volume_create_manager' (bba44bcb-b5ce-407b-bd9f-d26effae20b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326f9e01-332f-4a66-aa69-5b9f15f6bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326f9e01-332f-4a66-aa69-5b9f15f6bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1634541767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9292d36-bce5-44c8-aca2-dbd0c26fcbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b6c621916348f2a9b7a2c1270ad37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:18Z,use_quota=True,user_id='e88bbfc75863484cb40b4884d79b28f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6be1f-e23f-4974-9c46-3a15c6dced46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6be1f-e23f-4974-9c46-3a15c6dced46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2ead12-3830-490e-af7b-ef84929b714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2ead12-3830-490e-af7b-ef84929b714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9292d36-bce5-44c8-aca2-dbd0c26fcbb2', 'volume_name': 'volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a811f7a1-cee8-4705-95ae-44314336b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a811f7a1-cee8-4705-95ae-44314336b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967526a-46f6-4676-bd3f-ea3caec0917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Volume b9292d36-bce5-44c8-aca2-dbd0c26fcbb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2', 'volume_size': 1} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1634541767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9292d36-bce5-44c8-aca2-dbd0c26fcbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b6c621916348f2a9b7a2c1270ad37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:18Z,use_quota=True,user_id='e88bbfc75863484cb40b4884d79b28f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Creating volume b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:18 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 1073741824 Jul 23 03:25:18 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac" returned: 0 in 0.615s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac Jul 23 03:25:18 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-63a4f293-b365-4493-9ec4-332f537d73ac" returned: 0 in 0.443s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-quobyte-63a4f293-b365-4493-9ec4-332f537d73ac" released by "delete_volume" :: held 1.135s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:18 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 1073741824" returned: 0 in 0.622s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Created reservations ['b3636ad3-a506-4a2e-b000-2e634916c1d5', '042ef5b3-25cd-4938-94ad-2e80ec2cd31e', '5b1cb6c2-94e2-4580-8e8b-2b06dd90e3cd', '6a24ff59-6b67-4bf9-a2ef-bc6325481ce0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 Jul 23 03:25:18 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:18 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.325s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Deleted volume successfully. Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7c510d68-f9d3-4254-b874-9db5e9fa2d8b tempest-AttachVolumeTestJSON-1770636334 None] Lock "cinder-63a4f293-b365-4493-9ec4-332f537d73ac-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:19 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" returned: 0 in 0.478s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967526a-46f6-4676-bd3f-ea3caec0917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ef1f9-c496-4333-b20b-800bc9626566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Volume volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 (b9292d36-bce5-44c8-aca2-dbd0c26fcbb2): created successfully Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ef1f9-c496-4333-b20b-800bc9626566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Flow 'volume_create_manager' (bba44bcb-b5ce-407b-bd9f-d26effae20b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9bdac030-cee1-4156-9f8d-ae6d99d543cd tempest-TestMinimumBasicScenario-1206451042 None] Created volume successfully. Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:20 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:20 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:20 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.623s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:20 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e6df6121-7c0f-4277-bc89-ecff21b3581c tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Retype volume completed successfully. Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "cinder-151dd34a-7515-46a4-8d02-36251c88cfb6-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "cinder-151dd34a-7515-46a4-8d02-36251c88cfb6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "cinder-quobyte-151dd34a-7515-46a4-8d02-36251c88cfb6" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "cinder-quobyte-151dd34a-7515-46a4-8d02-36251c88cfb6" acquired by "delete_volume" :: waited 0.047s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[be249fd2-f792-4e28-a38b-ec9dfaf63203]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:22 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 Jul 23 03:25:22 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a5f045c3-2ffa-4293-9294-8fb2e40d23e2 req-640acf6c-a780-4898-86ca-54cc1621ac21 tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a5f045c3-2ffa-4293-9294-8fb2e40d23e2 req-640acf6c-a780-4898-86ca-54cc1621ac21 tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a5f045c3-2ffa-4293-9294-8fb2e40d23e2 req-640acf6c-a780-4898-86ca-54cc1621ac21 tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-a5f045c3-2ffa-4293-9294-8fb2e40d23e2 req-640acf6c-a780-4898-86ca-54cc1621ac21 tempest-TestMinimumBasicScenario-1206451042 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbf4968b-ac30-4ed9-ba50-7b0b2ec263eb', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:25:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a5f045c3-2ffa-4293-9294-8fb2e40d23e2 req-640acf6c-a780-4898-86ca-54cc1621ac21 tempest-TestMinimumBasicScenario-1206451042 None] attachment_update completed successfully. Jul 23 03:25:22 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6" returned: 0 in 0.825s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:22 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6 Jul 23 03:25:22 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:23 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-151dd34a-7515-46a4-8d02-36251c88cfb6" returned: 0 in 0.650s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "cinder-quobyte-151dd34a-7515-46a4-8d02-36251c88cfb6" released by "delete_volume" :: held 1.579s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:23 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:23 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Created reservations ['e06d42ce-f436-4a79-822c-36b1a6a347f1', '861066b2-d0c7-41ed-b43b-d10986b0ec2f', '813f8a51-df8b-4aeb-972a-95bc78e47f49', '9e05c31d-0d77-4063-8533-399d2f30db1b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:23 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:23 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:24 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.703s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:24 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Deleted volume successfully. Jul 23 03:25:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bc4b1ac6-59d4-416a-b2c0-746aadd16693 tempest-VolumeRetypeWithoutMigrationTest-192503976 None] Lock "cinder-151dd34a-7515-46a4-8d02-36251c88cfb6-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5ed8c114-f01d-4393-a13d-475a7d3feb95 tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" by "attach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5ed8c114-f01d-4393-a13d-475a7d3feb95 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" acquired by "attach_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5ed8c114-f01d-4393-a13d-475a7d3feb95 tempest-VolumesActionsTest-789206733 None] Attaching volume 1f053a2e-9e88-4cef-9b5d-a028574e2537 to instance 8709ae72-6159-48a9-8cd5-b79bf7d554e4 at mountpoint /dev/vdb on host None. Jul 23 03:25:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5ed8c114-f01d-4393-a13d-475a7d3feb95 tempest-VolumesActionsTest-789206733 None] Attach volume completed successfully. Jul 23 03:25:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5ed8c114-f01d-4393-a13d-475a7d3feb95 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" released by "attach_volume" :: held 0.131s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9125db8-267a-4cf2-8483-b8531777dfad tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" by "detach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9125db8-267a-4cf2-8483-b8531777dfad tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a9125db8-267a-4cf2-8483-b8531777dfad tempest-VolumesActionsTest-789206733 None] Detaching volume 1f053a2e-9e88-4cef-9b5d-a028574e2537 from instance 8709ae72-6159-48a9-8cd5-b79bf7d554e4. Jul 23 03:25:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a9125db8-267a-4cf2-8483-b8531777dfad tempest-VolumesActionsTest-789206733 None] Detach volume completed successfully. Jul 23 03:25:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a9125db8-267a-4cf2-8483-b8531777dfad tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Flow 'volume_create_manager' (0c91882f-1ea7-4547-adf2-94c74e4e25c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb5c50-a05f-4190-91d6-bf6a212cb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb5c50-a05f-4190-91d6-bf6a212cb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1786740397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b956bf-1d1e-4dcb-8b4d-740fb3af20bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268f6a0329cc41e0b08502742c138cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:34Z,use_quota=True,user_id='2bacabd8b1cb4a348aa2168d9ab0de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f1596-8e2b-4948-a2cb-46555db46585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f1596-8e2b-4948-a2cb-46555db46585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bf8bd4-e9e7-4b00-8b0d-feab8c4ab364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bf8bd4-e9e7-4b00-8b0d-feab8c4ab364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b956bf-1d1e-4dcb-8b4d-740fb3af20bf', 'volume_name': 'volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83af4d5-9ba9-4198-b47e-fd143f606b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83af4d5-9ba9-4198-b47e-fd143f606b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5fc77c-8998-460b-a2ba-d50ac9de6f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:34 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Volume 30b956bf-1d1e-4dcb-8b4d-740fb3af20bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf', 'volume_size': 1} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1786740397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b956bf-1d1e-4dcb-8b4d-740fb3af20bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268f6a0329cc41e0b08502742c138cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:34Z,use_quota=True,user_id='2bacabd8b1cb4a348aa2168d9ab0de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Creating volume 30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:34 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:25:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf 1073741824 Jul 23 03:25:34 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf 1073741824" returned: 0 in 0.926s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf Jul 23 03:25:35 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" returned: 0 in 0.513s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5fc77c-8998-460b-a2ba-d50ac9de6f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01c52db-cefe-449f-816f-3fbee938c5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Volume volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf (30b956bf-1d1e-4dcb-8b4d-740fb3af20bf): created successfully Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01c52db-cefe-449f-816f-3fbee938c5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Flow 'volume_create_manager' (0c91882f-1ea7-4547-adf2-94c74e4e25c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e7713a3d-e80f-4cef-9053-35f1d79d8d13 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Created volume successfully. Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Creating offline snapshot 62905ed5-d430-4b4c-804a-d9f42b0203ab of volume 30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b988ee54-1220-4ea0-81bb-6e4bd9c8fed9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf Jul 23 03:25:37 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" returned: 0 in 0.449s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab 1G Jul 23 03:25:37 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab 1G" returned: 0 in 0.487s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab Jul 23 03:25:37 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab" returned: 0 in 0.416s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab is being set with open permissions: ugo+rw Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab Jul 23 03:25:38 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab" returned: 0 in 0.316s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info Jul 23 03:25:38 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info" returned: 0 in 0.367s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info is being set with open permissions: ugo+rw Jul 23 03:25:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info Jul 23 03:25:39 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.info" returned: 0 in 0.540s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7f71e158-19f8-4161-be8e-284890cb89e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Create snapshot completed successfully Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "cinder-62905ed5-d430-4b4c-804a-d9f42b0203ab-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-62905ed5-d430-4b4c-804a-d9f42b0203ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "cinder-quobyte-62905ed5-d430-4b4c-804a-d9f42b0203ab" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-62905ed5-d430-4b4c-804a-d9f42b0203ab" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Deleting offline snapshot 62905ed5-d430-4b4c-804a-d9f42b0203ab of volume 30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] snapshot_file for this snap is: volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a0a26-1f9d-48b9-b198-0432f1b6318f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab Jul 23 03:25:41 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab" returned: 0 in 0.615s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:41 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6958d0f-041c-4a80-92fb-0435bede7065]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf Jul 23 03:25:41 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab Jul 23 03:25:42 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab" returned: 0 in 0.469s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab Jul 23 03:25:42 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf.62905ed5-d430-4b4c-804a-d9f42b0203ab" returned: 0 in 0.458s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-62905ed5-d430-4b4c-804a-d9f42b0203ab" released by "_delete_snapshot" :: held 2.123s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" released by "delete_snapshot" :: held 2.167s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:43 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Created reservations ['1d1fb6d5-48d8-4814-b3a9-9a113d478371', '7cc08971-5ad5-4611-8202-1949e874a28b', 'faea6fd4-9e3b-499e-bb0d-df1fa794e39f', '53dc1ced-b082-4ba9-888a-62e67820deb4'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Delete snapshot completed successfully. Jul 23 03:25:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e488adc-4099-4385-b6bb-684ce044e3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-62905ed5-d430-4b4c-804a-d9f42b0203ab-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "cinder-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a8765-37f3-4e91-9997-28c243754120]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-75dc1eab-af3b-494e-b0e2-ff2b802b3769 tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" by "attach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-75dc1eab-af3b-494e-b0e2-ff2b802b3769 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" acquired by "attach_volume" :: waited 0.045s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-75dc1eab-af3b-494e-b0e2-ff2b802b3769 tempest-VolumesActionsTest-789206733 None] Attaching volume 1f053a2e-9e88-4cef-9b5d-a028574e2537 to instance 10c16cd4-8a0d-434f-8630-bd1bfd078204 at mountpoint /dev/vdb on host None. Jul 23 03:25:44 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf Jul 23 03:25:44 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-75dc1eab-af3b-494e-b0e2-ff2b802b3769 tempest-VolumesActionsTest-789206733 None] Attach volume completed successfully. Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-75dc1eab-af3b-494e-b0e2-ff2b802b3769 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537" released by "attach_volume" :: held 0.129s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1ff63abc-f4bd-4be9-b4af-aab42bf2e009 tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" by "detach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1ff63abc-f4bd-4be9-b4af-aab42bf2e009 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1ff63abc-f4bd-4be9-b4af-aab42bf2e009 tempest-VolumesActionsTest-789206733 None] Detaching volume 1f053a2e-9e88-4cef-9b5d-a028574e2537 from instance 10c16cd4-8a0d-434f-8630-bd1bfd078204. Jul 23 03:25:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1ff63abc-f4bd-4be9-b4af-aab42bf2e009 tempest-VolumesActionsTest-789206733 None] Detach volume completed successfully. Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1ff63abc-f4bd-4be9-b4af-aab42bf2e009 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:45 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" returned: 0 in 0.696s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf Jul 23 03:25:45 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" returned: 0 in 0.488s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-quobyte-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf" released by "delete_volume" :: held 1.294s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Created reservations ['9335da00-d1b4-4127-9a8a-d48a7e838d04', '56369f2d-f664-4dfb-90c7-a7b7e399e2f1', '8b9e2710-c3da-4b1d-b734-7cbd2a915ee2', 'b37c06bd-2b2c-4fcb-950d-ac9d7c92f886'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:45 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:46 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.386s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:46 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Deleted volume successfully. Jul 23 03:25:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7fe4ee0d-db88-48f5-aaa7-c410399dd026 tempest-VolumeSnapshotQuotasNegativeTestJSON-1929548134 None] Lock "cinder-30b956bf-1d1e-4dcb-8b4d-740fb3af20bf-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:47 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:25:47 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:48 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:25:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714daf9-837f-4337-89a9-4f7df5d8fbbb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:25:50 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.443s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b363f-e670-469d-bc32-92bdec352035]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:25:50 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:51 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.471s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.de6b7311-3e64-4040-8a22-db4701623048rghlpkw7.img {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:51 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.de6b7311-3e64-4040-8a22-db4701623048rghlpkw7.img Jul 23 03:25:51 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:56 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:DELETE=6,cinder:INSERT=15 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:25:57 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.de6b7311-3e64-4040-8a22-db4701623048rghlpkw7.img" returned: 0 in 6.548s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7accab14-e909-4dad-b9d1-786df708f238]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:57 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:25:57 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:58 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.674s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:58 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.de6b7311-3e64-4040-8a22-db4701623048rghlpkw7.img {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:25:58 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Converted 1024.00 MB image at 156.29 MB/s Jul 23 03:25:58 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] de6b7311-3e64-4040-8a22-db4701623048 was raw, no need to convert to raw {{(pid=88466) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 23 03:26:00 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=62,cinder:DELETE=5,cinder:SELECT=79,cinder:INSERT=18 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:08 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-973151ae-f90c-493e-ba50-4e20bfe2ce55 req-366faa21-803d-4c62-b788-784f9afccc77 tempest-TestMinimumBasicScenario-1206451042 None] Terminate volume connection completed successfully. Jul 23 03:26:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-973151ae-f90c-493e-ba50-4e20bfe2ce55 req-366faa21-803d-4c62-b788-784f9afccc77 tempest-TestMinimumBasicScenario-1206451042 None] Deleting attachment cbf4968b-ac30-4ed9-ba50-7b0b2ec263eb. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "cinder-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "cinder-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "cinder-quobyte-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "cinder-quobyte-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b3f4b-623f-4cd3-917c-316d46f4ef2b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:24 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 Jul 23 03:26:24 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:24 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" returned: 0 in 0.660s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:24 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2 Jul 23 03:26:24 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:25 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" returned: 0 in 0.639s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "cinder-quobyte-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2" released by "delete_volume" :: held 1.373s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Created reservations ['e3e5ac0f-7676-4642-84fe-9bc65cb2b734', '1a5c5d0d-0120-46ed-a71d-b3fd90b13f50', '3536cb20-0156-49a7-ae20-73cf54b72b60', '522a9fdc-63e2-4685-9a62-da9ab5acdf03'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:25 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:25 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:26 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.485s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:26 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Deleted volume successfully. Jul 23 03:26:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79f2c4a8-3a4b-41f0-aa22-2c8e40714074 tempest-TestMinimumBasicScenario-1206451042 None] Lock "cinder-b9292d36-bce5-44c8-aca2-dbd0c26fcbb2-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.593s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Uploaded volume to glance image-id: de6b7311-3e64-4040-8a22-db4701623048. {{(pid=88466) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:26:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b2218955-d818-48f8-94ba-09c9e7315593 tempest-VolumesActionsTest-789206733 None] Copy volume to image completed successfully. Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1609478c-0b3e-482a-b249-d699a3a47b03]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:31 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:26:31 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:31 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.516s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0140d1bd-2017-4010-8c1b-2c75d7720983]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:31 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:26:31 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:32 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img Jul 23 03:26:32 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:33 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (3363e84f-7a0d-42f1-9167-0d5ac9aa4428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a582af-4656-423d-ab33-e209ab94e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a582af-4656-423d-ab33-e209ab94e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1793193674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfe27f6-a833-470d-a9d6-d5395b0051a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:34Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53ba36-4323-4339-a10f-1c961386da23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53ba36-4323-4339-a10f-1c961386da23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ded0e0-0b30-417c-979a-cfd40fb6bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ded0e0-0b30-417c-979a-cfd40fb6bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfe27f6-a833-470d-a9d6-d5395b0051a3', 'volume_name': 'volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8b07a-18a1-4ded-b83a-3732de2a875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8b07a-18a1-4ded-b83a-3732de2a875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1380c5-6357-4338-bf16-4bc950a0d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Volume 7dfe27f6-a833-470d-a9d6-d5395b0051a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3', 'volume_size': 1} Jul 23 03:26:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:38 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img" returned: 0 in 5.921s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abfd319-a86d-4505-ae26-caf0c82ffe81]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:38 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:26:38 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:38 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.685s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:26:38 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Converted 1024.00 MB image at 172.91 MB/s Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] 355fa039-3e9c-4aa3-ad26-0dec68f0a025 was raw, converting to qcow2 {{(pid=88466) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1f5de-a3e3-4519-acf1-6fef21372fcf]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:38 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img Jul 23 03:26:38 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:39 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:39 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img Jul 23 03:26:39 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:39 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img" returned: 1 in 0.541s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:26:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:39 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46 Jul 23 03:26:39 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:40 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46" returned: 0 in 0.310s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:40 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Image conversion details: src /opt/stack/data/cinder/conversion/1f053a2e-9e88-4cef-9b5d-a028574e2537.temp_image.355fa039-3e9c-4aa3-ad26-0dec68f0a025e2jw7rhe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:26:40 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 23 03:26:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ed616-a53a-424d-bfad-989668a15de6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:40 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46 Jul 23 03:26:40 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:40 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4ifdbt46" returned: 0 in 0.399s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.805s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Uploaded volume to glance image-id: 355fa039-3e9c-4aa3-ad26-0dec68f0a025. {{(pid=88466) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.712s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1793193674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfe27f6-a833-470d-a9d6-d5395b0051a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:34Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Creating volume 7dfe27f6-a833-470d-a9d6-d5395b0051a3 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:42 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:42 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 1073741824 Jul 23 03:26:42 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c49921ac-e9d7-42b2-8328-48f89fceed2e tempest-VolumesActionsTest-789206733 None] Copy volume to image completed successfully. Jul 23 03:26:43 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 1073741824" returned: 0 in 0.640s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:43 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 Jul 23 03:26:43 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:43 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1380c5-6357-4338-bf16-4bc950a0d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d18de-4c53-408e-a58e-ac5448926d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Volume volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 (7dfe27f6-a833-470d-a9d6-d5395b0051a3): created successfully Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d18de-4c53-408e-a58e-ac5448926d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (3363e84f-7a0d-42f1-9167-0d5ac9aa4428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e9d58ea6-d52b-4c6e-975b-a0038d0af177 tempest-VolumesListAdminTestJSON-771357697 None] Created volume successfully. Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Acquiring lock "cinder-quobyte-1f053a2e-9e88-4cef-9b5d-a028574e2537" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "cinder-quobyte-1f053a2e-9e88-4cef-9b5d-a028574e2537" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e39ea3-0d2e-48ec-9136-12e7125e6641]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:26:45 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:46 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (4be1e81f-74f3-4395-988c-2ff6e4255d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef9a75b-c8fb-44c2-8744-2a4b55d37f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.684s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef9a75b-c8fb-44c2-8744-2a4b55d37f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-706336489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e91b192-89d9-4492-9b36-ff052fca1684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:46Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bab7c0d-d44e-4dbb-adba-5f8eb920248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bab7c0d-d44e-4dbb-adba-5f8eb920248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:46 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537 Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ad0c81-dd44-4530-a510-2321b96824d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:46 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ad0c81-dd44-4530-a510-2321b96824d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e91b192-89d9-4492-9b36-ff052fca1684', 'volume_name': 'volume-8e91b192-89d9-4492-9b36-ff052fca1684', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb41f1b0-696c-432d-8eeb-b50f9ec10f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb41f1b0-696c-432d-8eeb-b50f9ec10f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54bbfb-49a8-4f6d-a44a-8e0e93ad1ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Volume 8e91b192-89d9-4492-9b36-ff052fca1684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e91b192-89d9-4492-9b36-ff052fca1684', 'volume_size': 1} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-706336489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e91b192-89d9-4492-9b36-ff052fca1684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:46Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Creating volume 8e91b192-89d9-4492-9b36-ff052fca1684 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 1073741824 Jul 23 03:26:46 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1f053a2e-9e88-4cef-9b5d-a028574e2537" returned: 0 in 0.573s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "cinder-quobyte-1f053a2e-9e88-4cef-9b5d-a028574e2537" released by "delete_volume" :: held 1.341s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:46 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Created reservations ['aaf2a895-0879-4f4b-90e6-45ea34217cad', 'a4fb5a17-76ff-4493-85e1-dc88f74b26fe', '7760e8ce-1815-4f1d-bb5d-a0f4a5a41fd0', '9cc3c736-7f78-4960-9da4-16e604dabe92'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (2f04a714-7afc-4d44-a777-b04d51acd251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:47 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec591559-3781-4230-8993-1f9382854b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec591559-3781-4230-8993-1f9382854b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824512741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682f5482-dd62-42a6-b5bf-7ba0f5e8f934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:47Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd454ba4-2e7c-4428-a4cc-21239f604e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd454ba4-2e7c-4428-a4cc-21239f604e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90dd4af-9f5b-470d-a71d-2f04db82a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90dd4af-9f5b-470d-a71d-2f04db82a54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682f5482-dd62-42a6-b5bf-7ba0f5e8f934', 'volume_name': 'volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374cae54-68ae-411e-bdb6-54105802da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374cae54-68ae-411e-bdb6-54105802da53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07378d0e-eafa-49f3-b0e4-a7dcb3c9fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Volume 682f5482-dd62-42a6-b5bf-7ba0f5e8f934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934', 'volume_size': 1} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 1073741824" returned: 0 in 0.891s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:47 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 Jul 23 03:26:47 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Deleted volume successfully. Jul 23 03:26:47 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824512741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682f5482-dd62-42a6-b5bf-7ba0f5e8f934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:47Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Creating volume 682f5482-dd62-42a6-b5bf-7ba0f5e8f934 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:47 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54bbfb-49a8-4f6d-a44a-8e0e93ad1ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e91b192-89d9-4492-9b36-ff052fca1684', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fd94b8-a55e-4210-a86d-5a1f06d6910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:47 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 1073741824 Jul 23 03:26:47 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Volume volume-8e91b192-89d9-4492-9b36-ff052fca1684 (8e91b192-89d9-4492-9b36-ff052fca1684): created successfully Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fd94b8-a55e-4210-a86d-5a1f06d6910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (4be1e81f-74f3-4395-988c-2ff6e4255d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c7c1d2e9-3793-4b83-aeae-8bdbe87a19d7 tempest-VolumesActionsTest-789206733 None] Lock "cinder-1f053a2e-9e88-4cef-9b5d-a028574e2537-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-38ee1066-5dc0-45e5-8c72-208f77174683 tempest-VolumesListAdminTestJSON-771357697 None] Created volume successfully. Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:47 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.341s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:26:48 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 1073741824" returned: 0 in 0.811s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 Jul 23 03:26:48 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" returned: 0 in 0.521s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07378d0e-eafa-49f3-b0e4-a7dcb3c9fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3d037c-697b-4cb3-8f18-e3ee7c804dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Volume volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 (682f5482-dd62-42a6-b5bf-7ba0f5e8f934): created successfully Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3d037c-697b-4cb3-8f18-e3ee7c804dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (2f04a714-7afc-4d44-a777-b04d51acd251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (e0fba13e-b378-4a99-812f-ce0a8ca70302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd20241-960c-42e8-a42e-508894c17466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-12ab9fc1-540a-423f-bbf8-987172a78ee8 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd20241-960c-42e8-a42e-508894c17466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-162866797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0871c0f-a0ef-47c7-822e-caa0760a9fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:49Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99fd705-2913-4d0d-a3d1-6f58dfdd1248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99fd705-2913-4d0d-a3d1-6f58dfdd1248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946c80d8-f8cb-4542-bc52-ef62138afb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946c80d8-f8cb-4542-bc52-ef62138afb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0871c0f-a0ef-47c7-822e-caa0760a9fd7', 'volume_name': 'volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e076f898-e21a-4d65-b75a-117066cf0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e076f898-e21a-4d65-b75a-117066cf0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a4a8e0-af83-4b1a-8e91-9bb700bd33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Volume f0871c0f-a0ef-47c7-822e-caa0760a9fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7', 'volume_size': 1} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-162866797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0871c0f-a0ef-47c7-822e-caa0760a9fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356138182f5146b0a692f8ac04c54253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:49Z,use_quota=True,user_id='98cd77d743fb4e86ad7f97b042f9f485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Creating volume f0871c0f-a0ef-47c7-822e-caa0760a9fd7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:49 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 1073741824 Jul 23 03:26:49 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 1073741824" returned: 0 in 0.613s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 Jul 23 03:26:49 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1397bd0a-a93d-4348-8488-7eb279be97cf tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" by "attach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1397bd0a-a93d-4348-8488-7eb279be97cf tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" acquired by "attach_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1397bd0a-a93d-4348-8488-7eb279be97cf tempest-VolumesActionsTest-1572309971 None] Attaching volume 682f5482-dd62-42a6-b5bf-7ba0f5e8f934 to instance 3bb36207-dde7-41b6-bc8c-2d6c56018031 at mountpoint /dev/vdb on host None. Jul 23 03:26:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1397bd0a-a93d-4348-8488-7eb279be97cf tempest-VolumesActionsTest-1572309971 None] Attach volume completed successfully. Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1397bd0a-a93d-4348-8488-7eb279be97cf tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" released by "attach_volume" :: held 0.153s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:50 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" returned: 0 in 0.578s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a4a8e0-af83-4b1a-8e91-9bb700bd33f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9bc826-c494-40fa-9040-fdb1777ef170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Volume volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 (f0871c0f-a0ef-47c7-822e-caa0760a9fd7): created successfully Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9bc826-c494-40fa-9040-fdb1777ef170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Flow 'volume_create_manager' (e0fba13e-b378-4a99-812f-ce0a8ca70302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e10d7563-430d-482c-8fb7-68b3c9ab60c6 tempest-VolumesListAdminTestJSON-771357697 None] Created volume successfully. Jul 23 03:26:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Terminate volume connection completed successfully. Jul 23 03:26:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" by "detach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Detaching volume 682f5482-dd62-42a6-b5bf-7ba0f5e8f934 from instance 3bb36207-dde7-41b6-bc8c-2d6c56018031. Jul 23 03:26:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Detach volume completed successfully. Jul 23 03:26:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8be4b6fd-600c-4d14-b784-9c9885ee2ea4 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2b50d37-ea63-4c1b-8358-9128f757f1b0 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" by "detach_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2b50d37-ea63-4c1b-8358-9128f757f1b0 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b2b50d37-ea63-4c1b-8358-9128f757f1b0 tempest-VolumesActionsTest-1572309971 None] Volume detach called, but volume not attached. Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2b50d37-ea63-4c1b-8358-9128f757f1b0 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Flow 'volume_create_manager' (aad1ef81-f47b-4e0f-b596-e87a7ce88b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd22ab7-fab8-43e3-8330-b330647a0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd22ab7-fab8-43e3-8330-b330647a0acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d86e743-71d2-4275-8ac6-f94c751e2836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee2a7a16e0044758f2c1662441fe3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:52Z,use_quota=True,user_id='242f7b0b4c944080b2831e62c9541a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc49aa6-815c-4c05-8830-88ef0c3649f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc49aa6-815c-4c05-8830-88ef0c3649f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8a4635-2142-4424-86f9-eb04addf62f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8a4635-2142-4424-86f9-eb04addf62f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d86e743-71d2-4275-8ac6-f94c751e2836', 'volume_name': 'volume-9d86e743-71d2-4275-8ac6-f94c751e2836', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdf592-2c81-4fc7-a61f-d054d71857c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdf592-2c81-4fc7-a61f-d054d71857c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bbd23f-b357-45a2-b0a1-d9f1cac25fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Volume 9d86e743-71d2-4275-8ac6-f94c751e2836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d86e743-71d2-4275-8ac6-f94c751e2836', 'volume_size': 1} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d86e743-71d2-4275-8ac6-f94c751e2836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee2a7a16e0044758f2c1662441fe3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:52Z,use_quota=True,user_id='242f7b0b4c944080b2831e62c9541a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Creating volume 9d86e743-71d2-4275-8ac6-f94c751e2836 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:52 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:52 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 1073741824 Jul 23 03:26:52 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-quobyte-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-quobyte-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" acquired by "delete_volume" :: waited 0.053s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c6c57-0563-4dd6-be7c-d771ba1d26db]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 Jul 23 03:26:53 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 1073741824" returned: 0 in 0.793s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 Jul 23 03:26:53 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" returned: 0 in 0.677s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934 Jul 23 03:26:53 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836" returned: 0 in 0.522s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bbd23f-b357-45a2-b0a1-d9f1cac25fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d86e743-71d2-4275-8ac6-f94c751e2836', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e75536a-9f1d-49df-b5dc-81031790cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Volume volume-9d86e743-71d2-4275-8ac6-f94c751e2836 (9d86e743-71d2-4275-8ac6-f94c751e2836): created successfully Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e75536a-9f1d-49df-b5dc-81031790cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Flow 'volume_create_manager' (aad1ef81-f47b-4e0f-b596-e87a7ce88b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b7e55f64-a442-4d92-ab01-050a9c30a318 tempest-VolumesListAdminTestJSON-197777131 None] Created volume successfully. Jul 23 03:26:54 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" returned: 0 in 0.680s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-quobyte-682f5482-dd62-42a6-b5bf-7ba0f5e8f934" released by "delete_volume" :: held 1.432s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Created reservations ['7879e28f-58ab-4ce2-a6b4-a34dfd28dbce', '14f6a490-7a53-4cd3-87a4-0ade89647705', 'b132fdfb-2c92-4f00-9c2a-4ae16d58a401', '4125bcca-7304-470e-a4ab-bdc480715d5f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:54 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Acquiring lock "cinder-9d86e743-71d2-4275-8ac6-f94c751e2836-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "cinder-9d86e743-71d2-4275-8ac6-f94c751e2836-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Acquiring lock "cinder-quobyte-9d86e743-71d2-4275-8ac6-f94c751e2836" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "cinder-quobyte-9d86e743-71d2-4275-8ac6-f94c751e2836" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[def9507b-aba5-43f3-a09b-033d5632bc60]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-f0871c0f-a0ef-47c7-822e-caa0760a9fd7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-f0871c0f-a0ef-47c7-822e-caa0760a9fd7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:55 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 Jul 23 03:26:55 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-quobyte-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" acquired by "delete_volume" :: waited 0.047s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8301f7ea-1d59-42a6-99d6-8ccb23312e24]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.707s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Deleted volume successfully. Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49452ce7-8a4e-44bb-83b6-e2139c4feb07 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-682f5482-dd62-42a6-b5bf-7ba0f5e8f934-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:55 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 Jul 23 03:26:55 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836" returned: 0 in 0.809s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836 Jul 23 03:26:55 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" returned: 0 in 0.661s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7 Jul 23 03:26:55 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9d86e743-71d2-4275-8ac6-f94c751e2836" returned: 0 in 0.523s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "cinder-quobyte-9d86e743-71d2-4275-8ac6-f94c751e2836" released by "delete_volume" :: held 1.419s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Created reservations ['6a046c51-3a4d-446d-aacd-8d678bef6f71', 'eb5be75b-5eb7-4890-83b8-c28bf6f4b81a', '8f3244a4-01aa-4338-b446-5bbcf01b6ee6', 'ce800a3b-ab6f-45dd-82a6-9410c4beb262'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:56 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" returned: 0 in 0.561s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-f0871c0f-a0ef-47c7-822e-caa0760a9fd7" released by "delete_volume" :: held 1.340s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Created reservations ['f00c45fe-2eb2-4832-8a81-1687eb6b8c96', '93bf297b-b60f-44b9-adcb-36bf15605fb5', '8b1c2d02-d364-42a2-a866-8b9727a89924', 'c8770bf1-f55b-401f-8598-6ed819908d05'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:56 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:56 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Deleted volume successfully. Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-56bd06a1-858c-496a-a07b-435ff4277727 tempest-VolumesListAdminTestJSON-197777131 None] Lock "cinder-9d86e743-71d2-4275-8ac6-f94c751e2836-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:57 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.425s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Deleted volume successfully. Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-7d311d50-bf62-47b8-b36b-eb9f9a784edb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-f0871c0f-a0ef-47c7-822e-caa0760a9fd7-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-8e91b192-89d9-4492-9b36-ff052fca1684-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-8e91b192-89d9-4492-9b36-ff052fca1684-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-quobyte-8e91b192-89d9-4492-9b36-ff052fca1684" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-8e91b192-89d9-4492-9b36-ff052fca1684" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8d59a-7478-49df-93e4-606e92b055e6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 Jul 23 03:26:58 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684" returned: 0 in 0.633s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684 Jul 23 03:26:58 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e91b192-89d9-4492-9b36-ff052fca1684" returned: 0 in 0.341s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-8e91b192-89d9-4492-9b36-ff052fca1684" released by "delete_volume" :: held 1.055s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Flow 'volume_create_manager' (cb35075f-a5f3-4bfa-b74a-7e5e668f5d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30b8206-763c-4a90-bc34-88d54d695801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Created reservations ['468c607f-a535-4f22-b836-3e51dd326abd', '0a234804-7c20-4d4f-992c-6b042f0bc107', '4fd8dc2e-f915-471d-bcb8-2d7f0b783726', 'fe51b9c6-445d-4e8b-93c0-1822cf40e17d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30b8206-763c-4a90-bc34-88d54d695801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1564237189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a3fddc-da09-4ce2-b185-01b2a1b5f92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f9bb14c39c4e33bfaf72dc8a2e5697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:59Z,use_quota=True,user_id='e9278ddc03954c87be1d6be2a277233c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f90be-545e-4a86-a79a-3d48c2cd2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f90be-545e-4a86-a79a-3d48c2cd2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6518c479-645a-4a61-97af-489b24ace0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6518c479-645a-4a61-97af-489b24ace0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a3fddc-da09-4ce2-b185-01b2a1b5f92b', 'volume_name': 'volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b', 'volume_size': 2}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63beabf-686c-415b-8b5e-6841a8f053c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63beabf-686c-415b-8b5e-6841a8f053c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a8a489-5233-4aa7-8939-1728fe652495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Volume 86a3fddc-da09-4ce2-b185-01b2a1b5f92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b', 'volume_size': 2} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1564237189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a3fddc-da09-4ce2-b185-01b2a1b5f92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f9bb14c39c4e33bfaf72dc8a2e5697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:59Z,use_quota=True,user_id='e9278ddc03954c87be1d6be2a277233c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Creating volume 86a3fddc-da09-4ce2-b185-01b2a1b5f92b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:59 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b 2147483648 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b 2147483648 Jul 23 03:26:59 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:26:59 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (a211f15a-c99b-4059-8176-4295416c50eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9909cdc-9386-42fc-b151-a0dc6c8a2687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9909cdc-9386-42fc-b151-a0dc6c8a2687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-95158144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:59Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b37ab0d-f038-4c37-96c1-01a5ee7aeabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b37ab0d-f038-4c37-96c1-01a5ee7aeabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdc8637-7ce3-40e2-b690-f1091e286a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdc8637-7ce3-40e2-b690-f1091e286a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c', 'volume_name': 'volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fc49f-a147-4d0c-8245-41b99aa1de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fc49f-a147-4d0c-8245-41b99aa1de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d981fa20-0764-4534-a52d-6debdca15b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Volume bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c', 'volume_size': 1} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Deleted volume successfully. Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79624db6-2c0a-40eb-aba0-383fc16659a7 tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-8e91b192-89d9-4492-9b36-ff052fca1684-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:59 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b 2147483648" returned: 0 in 0.599s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b Jul 23 03:26:59 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-7dfe27f6-a833-470d-a9d6-d5395b0051a3-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:00 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" returned: 0 in 0.281s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-95158144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:59Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Creating volume bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:00 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-7dfe27f6-a833-470d-a9d6-d5395b0051a3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a8a489-5233-4aa7-8939-1728fe652495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b', 'volume_size': 2}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:00 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c 1073741824 Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b20779e-c6f8-4f9a-95c3-3edcb1458b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:00 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Volume volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b (86a3fddc-da09-4ce2-b185-01b2a1b5f92b): created successfully Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b20779e-c6f8-4f9a-95c3-3edcb1458b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Flow 'volume_create_manager' (cb35075f-a5f3-4bfa-b74a-7e5e668f5d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "cinder-quobyte-7dfe27f6-a833-470d-a9d6-d5395b0051a3" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-203e16c1-8b54-42dc-a89e-2a140defd69d tempest-VolumesCloneNegativeTest-657392528 None] Created volume successfully. Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-7dfe27f6-a833-470d-a9d6-d5395b0051a3" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42ae04-fa9e-4fbd-a1ce-231b9532e8dc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 Jul 23 03:27:00 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c 1073741824" returned: 0 in 0.600s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3" returned: 0 in 0.490s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3 Jul 23 03:27:00 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c Jul 23 03:27:00 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7dfe27f6-a833-470d-a9d6-d5395b0051a3" returned: 0 in 0.267s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-quobyte-7dfe27f6-a833-470d-a9d6-d5395b0051a3" released by "delete_volume" :: held 0.808s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Created reservations ['b53b1697-cced-49f4-a20f-bb0c4be5701c', '77e4df8c-a8ab-479c-877a-a9b1d1f669b9', '592d21f2-a9ac-4de2-b234-564de089bec2', '0babf72f-778e-43d8-9c3e-072d37338d7e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:01 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d981fa20-0764-4534-a52d-6debdca15b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f481e36-4fb3-4e27-9d05-ba1d8be9af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Volume volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c (bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c): created successfully Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f481e36-4fb3-4e27-9d05-ba1d8be9af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (a211f15a-c99b-4059-8176-4295416c50eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:01 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:01 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2a4883ef-7249-480d-bae3-1f8657da4621 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Acquiring lock "cinder-86a3fddc-da09-4ce2-b185-01b2a1b5f92b-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "cinder-86a3fddc-da09-4ce2-b185-01b2a1b5f92b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Acquiring lock "cinder-quobyte-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "cinder-quobyte-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" acquired by "delete_volume" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:01 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.496s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8e0d9-b2a4-4294-937d-1801c6794338]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Deleted volume successfully. Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-25988cfb-9063-4f36-9316-0a37005724bb tempest-VolumesListAdminTestJSON-771357697 None] Lock "cinder-7dfe27f6-a833-470d-a9d6-d5395b0051a3-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:01 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b Jul 23 03:27:01 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-quobyte-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773a84e-69e5-46fb-9745-aaaedcaea820]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:02 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c Jul 23 03:27:02 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:02 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" returned: 0 in 0.531s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:02 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b Jul 23 03:27:02 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:02 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" returned: 0 in 0.487s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:02 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c Jul 23 03:27:02 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:02 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" returned: 0 in 0.340s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "cinder-quobyte-86a3fddc-da09-4ce2-b185-01b2a1b5f92b" released by "delete_volume" :: held 0.950s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Created reservations ['a5deaf01-d053-47c4-a97a-b33932e740b1', '061f5eb5-8507-4943-99d2-6fca8b08c8d6', '5e0f2ff7-f690-406f-b441-312b72ddff0b', 'a4689b32-55d8-43a3-a812-79fbe11d365e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:02 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" returned: 0 in 0.417s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:02 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:02 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c" released by "delete_volume" :: held 0.966s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Created reservations ['fa6eb868-07d1-456e-996b-aeadab926833', '18314473-0cd6-43a6-81ed-29fbc386456c', '3b7586ec-d0c4-4469-8fda-1eba1dbf8656', '0853b6cc-07dd-4b54-b61b-23b6a595c0d1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:03 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:03 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:03 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Deleted volume successfully. Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0686b612-e6fa-4868-a24e-163e0a1291d6 tempest-VolumesCloneNegativeTest-657392528 None] Lock "cinder-86a3fddc-da09-4ce2-b185-01b2a1b5f92b-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:03 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Deleted volume successfully. Jul 23 03:27:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-dbf197a2-3d99-4968-9dee-3a30ff159996 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-bd0e13d8-5ee4-45ef-90d8-e97823b0ad9c-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (a41d008b-4a50-4bbf-ad7a-480854970cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50675d3c-fac0-4e2c-9fe1-441aa02218b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50675d3c-fac0-4e2c-9fe1-441aa02218b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-808544300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28166d47-f2f7-4178-99ef-52faca51f4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:05Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f068869b-4454-4b1c-9134-2cdc64addf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f068869b-4454-4b1c-9134-2cdc64addf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c72f0cc-741b-4f8f-b194-a89f201d3b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c72f0cc-741b-4f8f-b194-a89f201d3b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28166d47-f2f7-4178-99ef-52faca51f4bd', 'volume_name': 'volume-28166d47-f2f7-4178-99ef-52faca51f4bd', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44208092-1038-43e7-b495-d7573b93568e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44208092-1038-43e7-b495-d7573b93568e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7757d5-891b-48ab-899b-7102f0a5cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Volume 28166d47-f2f7-4178-99ef-52faca51f4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28166d47-f2f7-4178-99ef-52faca51f4bd', 'volume_size': 1} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-808544300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28166d47-f2f7-4178-99ef-52faca51f4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:05Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Creating volume 28166d47-f2f7-4178-99ef-52faca51f4bd {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:04 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd 1073741824 Jul 23 03:27:04 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd 1073741824" returned: 0 in 0.559s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:05 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd Jul 23 03:27:05 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd" returned: 0 in 0.339s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7757d5-891b-48ab-899b-7102f0a5cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28166d47-f2f7-4178-99ef-52faca51f4bd', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6117eadc-324d-4280-8186-55475b35ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:05 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Volume volume-28166d47-f2f7-4178-99ef-52faca51f4bd (28166d47-f2f7-4178-99ef-52faca51f4bd): created successfully Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6117eadc-324d-4280-8186-55475b35ecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (a41d008b-4a50-4bbf-ad7a-480854970cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-90547367-e6f9-4ac8-ae1c-5fea7ad3dd43 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-28166d47-f2f7-4178-99ef-52faca51f4bd-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "cinder-28166d47-f2f7-4178-99ef-52faca51f4bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-quobyte-28166d47-f2f7-4178-99ef-52faca51f4bd" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-28166d47-f2f7-4178-99ef-52faca51f4bd" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7045ea5-042c-4c33-baf6-29b3385775a2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd Jul 23 03:27:07 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd Jul 23 03:27:07 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-28166d47-f2f7-4178-99ef-52faca51f4bd" returned: 0 in 0.299s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-28166d47-f2f7-4178-99ef-52faca51f4bd" released by "delete_volume" :: held 0.849s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Created reservations ['b8a4b6ac-2a51-4a0c-901a-ff349c732ccc', 'b570c8a6-23b3-47f4-90f6-7c1d893ec687', 'ee3a752e-fec0-4215-be9a-72378adb7b78', '556d33c9-685f-480b-9853-870f5f8e2311'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:08 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.370s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Deleted volume successfully. Jul 23 03:27:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-aa4bfb72-77f2-4d86-aea0-c6347dfe9abc tempest-VolumesActionsTest-1764677958 None] Lock "cinder-28166d47-f2f7-4178-99ef-52faca51f4bd-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (c80d7b0f-76fc-47e2-937c-0dd6550a7ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c742e503-a3e8-481b-9c36-579d77a54cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c742e503-a3e8-481b-9c36-579d77a54cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039597604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c20cde-26fe-4a60-a695-113f539169b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:09Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac77b5c-1e86-45c5-9ac2-606a9457ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac77b5c-1e86-45c5-9ac2-606a9457ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e8cf1e-a89a-4360-94de-a4deeb98548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e8cf1e-a89a-4360-94de-a4deeb98548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c20cde-26fe-4a60-a695-113f539169b4', 'volume_name': 'volume-77c20cde-26fe-4a60-a695-113f539169b4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f30ae3b-8959-4d05-b08f-098ff14efba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f30ae3b-8959-4d05-b08f-098ff14efba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340677c-cd16-4a24-b5d9-5ed5468cff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Volume 77c20cde-26fe-4a60-a695-113f539169b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c20cde-26fe-4a60-a695-113f539169b4', 'volume_size': 1} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039597604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c20cde-26fe-4a60-a695-113f539169b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:09Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Creating volume 77c20cde-26fe-4a60-a695-113f539169b4 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:09 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 1073741824 Jul 23 03:27:09 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Flow 'volume_create_manager' (a0b67b8d-4920-481f-ab47-5c496a9ecabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4140700a-1f3b-4663-8c02-961e2530b139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4140700a-1f3b-4663-8c02-961e2530b139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-461242278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47acd81-fae8-4c9d-81c4-f865e6643116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba5a03c6ac54499bb74b8cda77258d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:10Z,use_quota=True,user_id='218e181bd85c446ea80cfecb20bbf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f855db-4da5-4a10-9ddc-1189e5892976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f855db-4da5-4a10-9ddc-1189e5892976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a05b760-dc6f-44b9-8046-fafbabb1f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:09 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:27:10 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 1073741824" returned: 0 in 0.628s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 Jul 23 03:27:10 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a05b760-dc6f-44b9-8046-fafbabb1f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c47acd81-fae8-4c9d-81c4-f865e6643116', 'volume_name': 'volume-c47acd81-fae8-4c9d-81c4-f865e6643116', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0525e57f-b2c9-4cf3-8347-639d1392e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0525e57f-b2c9-4cf3-8347-639d1392e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e88781-2eda-4b6f-b175-3c6debe9179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Volume c47acd81-fae8-4c9d-81c4-f865e6643116: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c47acd81-fae8-4c9d-81c4-f865e6643116', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Trying to clone c47acd81-fae8-4c9d-81c4-f865e6643116 from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:27:10 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4" returned: 0 in 0.423s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340677c-cd16-4a24-b5d9-5ed5468cff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c20cde-26fe-4a60-a695-113f539169b4', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a86334-8ad5-4be6-8af7-8af2eba007a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Volume volume-77c20cde-26fe-4a60-a695-113f539169b4 (77c20cde-26fe-4a60-a695-113f539169b4): created successfully Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a86334-8ad5-4be6-8af7-8af2eba007a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (c80d7b0f-76fc-47e2-937c-0dd6550a7ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-43b741ec-2fe9-4d05-915c-b5482ca62bb3 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:27:10 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bdb069-d6ef-4c5a-a05c-68719bf2a5ff]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD Jul 23 03:27:10 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Flow 'volume_create_manager' (22fa89f5-db47-4208-a3c6-20593723bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d81c0-42b9-42d0-9222-4ab52f66a379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d81c0-42b9-42d0-9222-4ab52f66a379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1048600940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb01691b-8577-4a8e-ad30-51bb3e7f94e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdcf5c6d3ee4c3c96c2b8930abb20b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:11Z,use_quota=True,user_id='c19d884561b34bf9b5c5b5edd5deb0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4942f0db-939b-4b9a-9c6e-00eb9079fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4942f0db-939b-4b9a-9c6e-00eb9079fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d9d195-012d-417b-8903-18195ece6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d9d195-012d-417b-8903-18195ece6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb01691b-8577-4a8e-ad30-51bb3e7f94e1', 'volume_name': 'volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48f0264-ec8e-4bd3-a7a4-4ce1f9f91d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48f0264-ec8e-4bd3-a7a4-4ce1f9f91d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d67a1cf-79b0-4225-895e-15c2b3654e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Volume cb01691b-8577-4a8e-ad30-51bb3e7f94e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1', 'volume_size': 1} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1048600940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb01691b-8577-4a8e-ad30-51bb3e7f94e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdcf5c6d3ee4c3c96c2b8930abb20b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:11Z,use_quota=True,user_id='c19d884561b34bf9b5c5b5edd5deb0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Creating volume cb01691b-8577-4a8e-ad30-51bb3e7f94e1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:11 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:11 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 is fetched for user 218e181bd85c446ea80cfecb20bbf882. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:27:11 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 1073741824 Jul 23 03:27:11 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033aa80-ab9b-4f69-b7a1-94a60563166d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:11 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD Jul 23 03:27:11 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-77c20cde-26fe-4a60-a695-113f539169b4-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-77c20cde-26fe-4a60-a695-113f539169b4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-quobyte-77c20cde-26fe-4a60-a695-113f539169b4" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-77c20cde-26fe-4a60-a695-113f539169b4" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d9eef-8efd-4441-90fc-869133eebfd3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:11 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:11 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 1073741824" returned: 0 in 0.678s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:11 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 Jul 23 03:27:11 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 Jul 23 03:27:12 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" returned: 0 in 0.298s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:12 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-461242278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47acd81-fae8-4c9d-81c4-f865e6643116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba5a03c6ac54499bb74b8cda77258d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:10Z,use_quota=True,user_id='218e181bd85c446ea80cfecb20bbf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Creating volume c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:12 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4" returned: 0 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1073741824 Jul 23 03:27:12 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d67a1cf-79b0-4225-895e-15c2b3654e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c50bb0-cfbb-49db-9e74-5059410bfd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:12 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4 Jul 23 03:27:12 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Volume volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 (cb01691b-8577-4a8e-ad30-51bb3e7f94e1): created successfully Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c50bb0-cfbb-49db-9e74-5059410bfd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Flow 'volume_create_manager' (22fa89f5-db47-4208-a3c6-20593723bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6a1806b5-ca02-4c9b-a18c-6220d11de41b tempest-VolumesTransfersV355Test-462942304 None] Created volume successfully. Jul 23 03:27:12 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-77c20cde-26fe-4a60-a695-113f539169b4" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-77c20cde-26fe-4a60-a695-113f539169b4" released by "delete_volume" :: held 0.795s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Created reservations ['f2ee66c0-9e15-4281-807f-2edccb5bafc2', '6338584c-ab3a-484c-8343-892e6248353c', '183830cc-807c-4a48-859e-bffa450ee258', '983be013-4af0-4251-98a4-a6e6dcb12476'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:12 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1073741824" returned: 0 in 0.492s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 Jul 23 03:27:12 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Deleted volume successfully. Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-903eecd1-613d-4163-abab-65c51a284732 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-77c20cde-26fe-4a60-a695-113f539169b4-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:13 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Attempting download of ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume c47acd81-fae8-4c9d-81c4-f865e6643116. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b7d1c-c84e-47ab-8835-9d4e040733d9]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n Jul 23 03:27:13 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (13d0c6e4-3b6f-4276-bc86-9fed18471293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c92409-31f0-4a3c-957e-6ad46b3069ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c92409-31f0-4a3c-957e-6ad46b3069ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1044267431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5038a6c8-9965-4651-bb3d-2167662f467f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:14Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9901ad1b-0a2b-4e17-aa1c-615297709947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9901ad1b-0a2b-4e17-aa1c-615297709947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3b0a23-48d0-4839-bd92-7a2fab77659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3b0a23-48d0-4839-bd92-7a2fab77659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5038a6c8-9965-4651-bb3d-2167662f467f', 'volume_name': 'volume-5038a6c8-9965-4651-bb3d-2167662f467f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848fdce-82b5-488a-9b2d-e3ebaaf91760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848fdce-82b5-488a-9b2d-e3ebaaf91760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe046a2-7989-4f8a-9a92-25e79975480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:13 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Volume 5038a6c8-9965-4651-bb3d-2167662f467f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5038a6c8-9965-4651-bb3d-2167662f467f', 'volume_size': 1} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1044267431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5038a6c8-9965-4651-bb3d-2167662f467f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:14Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Creating volume 5038a6c8-9965-4651-bb3d-2167662f467f {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:13 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n" returned: 0 in 0.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f 1073741824 Jul 23 03:27:13 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n Jul 23 03:27:13 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2680e1a9-6884-4962-b366-6920782549db tempest-VolumesTransfersV355Test-90871721 None] Transfer volume completed successfully. Jul 23 03:27:14 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n" returned: 1 in 0.437s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_1j89h41n' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ac9af-6c71-42ec-a24a-a5ebe946e692]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f 1073741824" returned: 0 in 0.597s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD Jul 23 03:27:14 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f Jul 23 03:27:14 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] ab7985a2-acac-4f9a-9e57-b9a25e5021d5 was qcow2, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:14 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 Jul 23 03:27:14 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "cinder-cb01691b-8577-4a8e-ad30-51bb3e7f94e1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-cb01691b-8577-4a8e-ad30-51bb3e7f94e1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:14 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f" returned: 0 in 0.519s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "cinder-quobyte-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe046a2-7989-4f8a-9a92-25e79975480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5038a6c8-9965-4651-bb3d-2167662f467f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8212a5-f994-4037-af7e-722601251393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:14 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Volume volume-5038a6c8-9965-4651-bb3d-2167662f467f (5038a6c8-9965-4651-bb3d-2167662f467f): created successfully Jul 23 03:27:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8212a5-f994-4037-af7e-722601251393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (13d0c6e4-3b6f-4276-bc86-9fed18471293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-quobyte-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" acquired by "delete_volume" :: waited 0.059s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-606a472e-5afc-43c3-b1cf-7ff7f845a9e9 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab044c-e3e5-4456-b790-0d3c6423a625]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 Jul 23 03:27:15 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1 Jul 23 03:27:15 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-quobyte-cb01691b-8577-4a8e-ad30-51bb3e7f94e1" released by "delete_volume" :: held 0.800s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Created reservations ['f4d09e70-6201-4462-8342-7bfbe690fec0', '1e07ce65-da73-4d94-896e-e18576aab89d', '08f607bc-1f24-4529-8736-3a6553d27165', 'fd650265-fb46-4217-bba2-a0884f990062'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-5038a6c8-9965-4651-bb3d-2167662f467f-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:16 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:16 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-5038a6c8-9965-4651-bb3d-2167662f467f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "cinder-quobyte-5038a6c8-9965-4651-bb3d-2167662f467f" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-5038a6c8-9965-4651-bb3d-2167662f467f" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31011f-263e-4020-bec7-8ae551b27d89]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:16 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f Jul 23 03:27:16 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.436s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Deleted volume successfully. Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-edad3c86-2644-43b0-a720-95f0295312b0 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-cb01691b-8577-4a8e-ad30-51bb3e7f94e1-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:16 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f" returned: 0 in 0.542s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:16 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f Jul 23 03:27:16 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Flow 'volume_create_manager' (485793ca-5660-4ea7-a6b3-22bae01a7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d3d77-0031-4b0c-9e6d-f537cb0a943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d3d77-0031-4b0c-9e6d-f537cb0a943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1412072051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb8d210-7329-4ee3-be28-5ebb7dc0eade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdcf5c6d3ee4c3c96c2b8930abb20b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:17Z,use_quota=True,user_id='c19d884561b34bf9b5c5b5edd5deb0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7043d4b-7015-4611-bfad-47f53ebae64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7043d4b-7015-4611-bfad-47f53ebae64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9b999-6343-4b18-b134-511a264bf1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda9b999-6343-4b18-b134-511a264bf1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb8d210-7329-4ee3-be28-5ebb7dc0eade', 'volume_name': 'volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b92a27-2294-41b7-9f29-966949befbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:16 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b92a27-2294-41b7-9f29-966949befbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:17 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3994b4c7-e570-43ed-b31f-daba1a823e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Volume 7fb8d210-7329-4ee3-be28-5ebb7dc0eade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade', 'volume_size': 1} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1412072051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb8d210-7329-4ee3-be28-5ebb7dc0eade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdcf5c6d3ee4c3c96c2b8930abb20b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:17Z,use_quota=True,user_id='c19d884561b34bf9b5c5b5edd5deb0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Creating volume 7fb8d210-7329-4ee3-be28-5ebb7dc0eade {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116" returned: 0 in 2.262s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5038a6c8-9965-4651-bb3d-2167662f467f" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_25n12niodevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Converted 112.00 MB image at 49.47 MB/s Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade 1073741824 Jul 23 03:27:17 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1G Jul 23 03:27:17 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-quobyte-5038a6c8-9965-4651-bb3d-2167662f467f" released by "delete_volume" :: held 0.949s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Created reservations ['b71f5985-29d2-486c-a444-c0b64626b98e', '93e88150-a95e-4ff8-aafa-edcd9d5087d4', 'baf7e730-a2c1-452b-b55b-9db7f65129d7', '7df75cc2-ae85-4713-a8f7-85194c7a9198'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:17 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:17 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 1G" returned: 0 in 0.501s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Downloaded image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume c47acd81-fae8-4c9d-81c4-f865e6643116 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 for user 218e181bd85c446ea80cfecb20bbf882 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Marking volume c47acd81-fae8-4c9d-81c4-f865e6643116 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Copying metadata from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 to c47acd81-fae8-4c9d-81c4-f865e6643116. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Creating volume glance metadata for volume c47acd81-fae8-4c9d-81c4-f865e6643116 backed by image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:27:17 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.376s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Deleted volume successfully. Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-88675aff-2601-4dfe-8505-44dd7d991795 tempest-VolumesActionsTest-1764677958 None] Lock "cinder-5038a6c8-9965-4651-bb3d-2167662f467f-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e88781-2eda-4b6f-b175-3c6debe9179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47acd81-fae8-4c9d-81c4-f865e6643116', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:17 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23b7324-defd-44ca-9b8d-3118620c3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade 1073741824" returned: 0 in 0.749s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Volume volume-c47acd81-fae8-4c9d-81c4-f865e6643116 (c47acd81-fae8-4c9d-81c4-f865e6643116): created successfully Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23b7324-defd-44ca-9b8d-3118620c3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Flow 'volume_create_manager' (a0b67b8d-4920-481f-ab47-5c496a9ecabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-40a21657-c382-4114-aa48-6923d780acb8 tempest-VolumesExtendTest-1328034190 None] Created volume successfully. Jul 23 03:27:17 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade Jul 23 03:27:17 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (55374922-81cf-49f6-a48b-1a00c0e5709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d81543-c4bd-4f00-9025-96c8168c414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d81543-c4bd-4f00-9025-96c8168c414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-740674508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a20a2f-4186-4141-81b6-422cbd27a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:18Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8156b111-c181-4b2f-8297-c878fbe68359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8156b111-c181-4b2f-8297-c878fbe68359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd7264-877a-428b-8ee3-2d60cbf01e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd7264-877a-428b-8ee3-2d60cbf01e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a20a2f-4186-4141-81b6-422cbd27a7e1', 'volume_name': 'volume-17a20a2f-4186-4141-81b6-422cbd27a7e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb609ad-3aaa-48eb-b3fd-b38e31a7f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb609ad-3aaa-48eb-b3fd-b38e31a7f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d7bf58-465a-44e9-b37f-c369cfa91342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Volume 17a20a2f-4186-4141-81b6-422cbd27a7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a20a2f-4186-4141-81b6-422cbd27a7e1', 'volume_size': 1} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:18 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" returned: 0 in 0.368s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-740674508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a20a2f-4186-4141-81b6-422cbd27a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab5e20bb434eb0887986b5e42e797b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:18Z,use_quota=True,user_id='2edca841fbd847858d8981875fcf0072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Creating volume 17a20a2f-4186-4141-81b6-422cbd27a7e1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:18 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3994b4c7-e570-43ed-b31f-daba1a823e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd2a9ef-45d5-4f9d-bc12-f8c702d3b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:18 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 1073741824 Jul 23 03:27:18 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Volume volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade (7fb8d210-7329-4ee3-be28-5ebb7dc0eade): created successfully Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd2a9ef-45d5-4f9d-bc12-f8c702d3b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Flow 'volume_create_manager' (485793ca-5660-4ea7-a6b3-22bae01a7951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a5da15ea-5122-40d5-8c6f-533a501bc305 tempest-VolumesTransfersV355Test-462942304 None] Created volume successfully. Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:18 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 1073741824" returned: 0 in 0.470s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=101,cinder:UPDATE=158,cinder:INSERT=35,cinder:DELETE=16 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:18 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 Jul 23 03:27:18 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.422s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d7bf58-465a-44e9-b37f-c369cfa91342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a20a2f-4186-4141-81b6-422cbd27a7e1', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88797434-311c-4375-a591-b1bd82366ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee386a6-6f16-4d95-a7b4-14da0c248401]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Volume volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 (17a20a2f-4186-4141-81b6-422cbd27a7e1): created successfully Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88797434-311c-4375-a591-b1bd82366ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Flow 'volume_create_manager' (55374922-81cf-49f6-a48b-1a00c0e5709d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b27c661e-cdf0-44c6-9de0-0fad51ba6049 tempest-VolumesActionsTest-1572309971 None] Created volume successfully. Jul 23 03:27:19 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 Jul 23 03:27:19 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "cinder-7fb8d210-7329-4ee3-be28-5ebb7dc0eade-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-7fb8d210-7329-4ee3-be28-5ebb7dc0eade-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "cinder-quobyte-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-quobyte-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f8db0-493d-4852-addc-451be656d77d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 2G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade Jul 23 03:27:19 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 2G" returned: 0 in 0.111s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.623s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a0ea15f7-9e29-446e-ad05-e7a87a47c8bb tempest-VolumesExtendTest-1328034190 None] Extend volume completed successfully. Jul 23 03:27:19 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" returned: 0 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade Jul 23 03:27:19 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" returned: 0 in 0.243s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-quobyte-7fb8d210-7329-4ee3-be28-5ebb7dc0eade" released by "delete_volume" :: held 0.672s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Created reservations ['6650f638-78af-468f-9945-d3c074757750', '76a9706d-7ed8-465c-ab51-b9b915405a63', 'ba0278cd-7a86-4438-be19-1103b5880b15', 'e458d937-9e92-4ff4-baef-088c88f9f066'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=152,cinder:SELECT=131,cinder:INSERT=48,cinder:DELETE=11 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:20 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:20 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Deleted volume successfully. Jul 23 03:27:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc22403f-f622-40a5-b80e-8056b4246f11 tempest-VolumesTransfersV355Test-1759210410 None] Lock "cinder-7fb8d210-7329-4ee3-be28-5ebb7dc0eade-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-17a20a2f-4186-4141-81b6-422cbd27a7e1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-17a20a2f-4186-4141-81b6-422cbd27a7e1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "cinder-quobyte-17a20a2f-4186-4141-81b6-422cbd27a7e1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-quobyte-17a20a2f-4186-4141-81b6-422cbd27a7e1" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f2f45-584e-402d-a072-ecfe295c3064]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-c47acd81-fae8-4c9d-81c4-f865e6643116-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "cinder-c47acd81-fae8-4c9d-81c4-f865e6643116-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-quobyte-c47acd81-fae8-4c9d-81c4-f865e6643116" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:21 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 Jul 23 03:27:21 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-c47acd81-fae8-4c9d-81c4-f865e6643116" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281fda1-f0a8-45ed-8abd-8df0b997e3fe]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 Jul 23 03:27:21 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:21 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1" returned: 0 in 0.484s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1 Jul 23 03:27:21 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:21 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116" returned: 0 in 0.600s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:22 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116 Jul 23 03:27:22 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:22 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-17a20a2f-4186-4141-81b6-422cbd27a7e1" returned: 0 in 0.339s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-quobyte-17a20a2f-4186-4141-81b6-422cbd27a7e1" released by "delete_volume" :: held 0.889s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Created reservations ['cb362d41-6188-4251-86bc-1bdc712bc9d3', 'bb5792d2-87e7-42e9-8be7-40668464ae0b', 'd20d3dd4-4132-4cd0-9035-80bf53688d56', 'fb41a135-5ab8-47cd-acb9-75d5515f3440'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:22 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:22 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:22 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c47acd81-fae8-4c9d-81c4-f865e6643116" returned: 0 in 0.350s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-c47acd81-fae8-4c9d-81c4-f865e6643116" released by "delete_volume" :: held 1.011s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Created reservations ['a28ebdf3-e687-4bf4-97f8-b874dd87899a', 'a9ef48e1-d5d5-499c-bf39-acf2071b8cb9', 'f7211b56-29de-4558-9497-8b291df3c64d', '2e150602-9cf1-4bd0-ac37-d99fc66b85be'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:22 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.327s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Deleted volume successfully. Jul 23 03:27:22 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:22 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-313a6a37-e4f1-4b3e-9967-022fed407e13 tempest-VolumesActionsTest-1572309971 None] Lock "cinder-17a20a2f-4186-4141-81b6-422cbd27a7e1-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:22 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Deleted volume successfully. Jul 23 03:27:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0fe6c217-6167-47e2-a79b-2f938d45659d tempest-VolumesExtendTest-1328034190 None] Lock "cinder-c47acd81-fae8-4c9d-81c4-f865e6643116-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Flow 'volume_create_manager' (7ec60488-349a-4e96-ae17-5bcff73579fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d4bf88-4f59-4dac-a803-3364b71f73d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d4bf88-4f59-4dac-a803-3364b71f73d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-483374786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982253ac-ee7a-4476-aaf6-529d4ff9b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba5a03c6ac54499bb74b8cda77258d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:24Z,use_quota=True,user_id='218e181bd85c446ea80cfecb20bbf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6f2757-5ca7-47e4-abd6-253b8fb347ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6f2757-5ca7-47e4-abd6-253b8fb347ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811106a7-377d-4150-95fd-f6ea2836bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811106a7-377d-4150-95fd-f6ea2836bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982253ac-ee7a-4476-aaf6-529d4ff9b97b', 'volume_name': 'volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223966c5-1992-4e3c-a4e5-b74c25779175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223966c5-1992-4e3c-a4e5-b74c25779175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae9861d-b9fc-48d1-b8a2-bc5d692e69cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Volume 982253ac-ee7a-4476-aaf6-529d4ff9b97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b', 'volume_size': 1} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-483374786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982253ac-ee7a-4476-aaf6-529d4ff9b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba5a03c6ac54499bb74b8cda77258d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:24Z,use_quota=True,user_id='218e181bd85c446ea80cfecb20bbf882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Creating volume 982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:24 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:24 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b 1073741824 Jul 23 03:27:24 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:24 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b 1073741824" returned: 0 in 0.476s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:24 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:24 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:24 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae9861d-b9fc-48d1-b8a2-bc5d692e69cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45358415-c8d8-4489-a654-0a9ef4f934cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:24 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Volume volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b (982253ac-ee7a-4476-aaf6-529d4ff9b97b): created successfully Jul 23 03:27:25 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45358415-c8d8-4489-a654-0a9ef4f934cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:25 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Flow 'volume_create_manager' (7ec60488-349a-4e96-ae17-5bcff73579fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ca7533f5-eb46-432f-8499-79fc4978f690 tempest-VolumesExtendTest-1328034190 None] Created volume successfully. Jul 23 03:27:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Creating offline snapshot 615d5e13-df43-4043-8a94-031a6446488e of volume 982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:27:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac7c02-aad0-44d4-9878-d55d517d57dc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:26 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:26 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:27 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.678s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:27 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e 1G Jul 23 03:27:27 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:27 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e 1G" returned: 0 in 0.664s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:27 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e Jul 23 03:27:27 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e is being set with open permissions: ugo+rw Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e Jul 23 03:27:28 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e" returned: 0 in 0.281s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info Jul 23 03:27:28 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:28 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info is being set with open permissions: ugo+rw Jul 23 03:27:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info Jul 23 03:27:28 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.info" returned: 0 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1ba9e014-6a84-4e0d-9018-b572d5440b66 tempest-VolumesExtendTest-1328034190 None] Create snapshot completed successfully Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (adef5162-0ac7-4422-9fff-59258264934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11ff75-ca69-43a6-98b7-3a4e12e876b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e11ff75-ca69-43a6-98b7-3a4e12e876b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1094167813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541b1fb2-d275-42c9-be86-aed5e26add12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:29Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff56de9e-face-472d-b3ba-309395f54dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff56de9e-face-472d-b3ba-309395f54dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2145bf6c-b723-4436-b1dc-14511c7ca0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2145bf6c-b723-4436-b1dc-14511c7ca0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541b1fb2-d275-42c9-be86-aed5e26add12', 'volume_name': 'volume-541b1fb2-d275-42c9-be86-aed5e26add12', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afc4ddc-da02-415d-939c-deec6e350262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afc4ddc-da02-415d-939c-deec6e350262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e919a-dc6a-45ee-8b01-2202a836dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Volume 541b1fb2-d275-42c9-be86-aed5e26add12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541b1fb2-d275-42c9-be86-aed5e26add12', 'volume_size': 1} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1094167813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541b1fb2-d275-42c9-be86-aed5e26add12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:29Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Creating volume 541b1fb2-d275-42c9-be86-aed5e26add12 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:29 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:29 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 1073741824 Jul 23 03:27:29 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:30 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 1073741824" returned: 0 in 0.616s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 Jul 23 03:27:30 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:30 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.778s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e919a-dc6a-45ee-8b01-2202a836dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541b1fb2-d275-42c9-be86-aed5e26add12', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbb5788-e27c-4aba-be3a-ab5934b194dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b9b2b-d140-4a16-8e77-6a20ae4700da]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Volume volume-541b1fb2-d275-42c9-be86-aed5e26add12 (541b1fb2-d275-42c9-be86-aed5e26add12): created successfully Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbb5788-e27c-4aba-be3a-ab5934b194dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (adef5162-0ac7-4422-9fff-59258264934e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:30 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9b1204b2-2ab7-4c4e-b155-fa39bdf38732 tempest-VolumesListTestJSON-1788427865 None] Created volume successfully. Jul 23 03:27:30 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:30 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:31 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.554s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e 2G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e 2G" returned: 0 in 0.189s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.824s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8706dcd5-5f96-4ca9-b531-338ab65cca04 tempest-VolumesExtendTest-1328034190 None] Extend volume completed successfully. Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-615d5e13-df43-4043-8a94-031a6446488e-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-615d5e13-df43-4043-8a94-031a6446488e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-quobyte-615d5e13-df43-4043-8a94-031a6446488e" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-615d5e13-df43-4043-8a94-031a6446488e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Deleting offline snapshot 615d5e13-df43-4043-8a94-031a6446488e of volume 982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] snapshot_file for this snap is: volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c26fe7-8bef-4e2d-88a7-01d6c03b8722]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (6f9735ee-4850-480f-bff9-64517ee1b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43572509-82f8-45a6-972e-caef473882d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43572509-82f8-45a6-972e-caef473882d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1502981701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e93585-0b41-4372-bc2b-45f5ff62ac9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:32Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eb6e1e-5bdc-4276-b848-241aaf514e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82eb6e1e-5bdc-4276-b848-241aaf514e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ea013a-0dd7-45bf-ada6-160993332395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ea013a-0dd7-45bf-ada6-160993332395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e93585-0b41-4372-bc2b-45f5ff62ac9a', 'volume_name': 'volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a0d221-4c1c-4d89-a0a6-f16992c2cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a0d221-4c1c-4d89-a0a6-f16992c2cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696fa159-d6d7-4f01-ba75-78a3c903bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:32 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Volume e0e93585-0b41-4372-bc2b-45f5ff62ac9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a', 'volume_size': 1} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1502981701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e93585-0b41-4372-bc2b-45f5ff62ac9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:32Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Creating volume e0e93585-0b41-4372-bc2b-45f5ff62ac9a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:32 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e Jul 23 03:27:32 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:32 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a 1073741824 Jul 23 03:27:32 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:32 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e" returned: 0 in 0.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe74a19-43d8-4461-8ca6-b93feacf2fd8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:32 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:32 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a 1073741824" returned: 0 in 0.564s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:33 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a Jul 23 03:27:33 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.682s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:33 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e Jul 23 03:27:33 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:33 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" returned: 0 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696fa159-d6d7-4f01-ba75-78a3c903bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e908f9-eeda-4c86-b9ed-a2128aa49db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:33 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Volume volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a (e0e93585-0b41-4372-bc2b-45f5ff62ac9a): created successfully Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e908f9-eeda-4c86-b9ed-a2128aa49db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (6f9735ee-4850-480f-bff9-64517ee1b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-18747677-c07c-46e0-84bf-53e691a4bff5 tempest-VolumesListTestJSON-1788427865 None] Created volume successfully. Jul 23 03:27:34 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e" returned: 0 in 0.560s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:34 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e Jul 23 03:27:34 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:34 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b.615d5e13-df43-4043-8a94-031a6446488e" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-615d5e13-df43-4043-8a94-031a6446488e" released by "_delete_snapshot" :: held 2.312s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" released by "delete_snapshot" :: held 2.364s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Created reservations ['e15b36ed-c0c3-433f-a902-0b353963bdbf', '0c589631-50e5-43d4-85f1-98ec4566971c', '9712882d-4306-41ec-92e8-57c83b64acf8', 'ea3c6158-5ab1-4677-88da-618294a1d5da'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:34 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Delete snapshot completed successfully. Jul 23 03:27:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9b7adbae-779f-447b-a784-0ee4f1312a3f tempest-VolumesExtendTest-1328034190 None] Lock "cinder-615d5e13-df43-4043-8a94-031a6446488e-delete_snapshot" released by "delete_snapshot" :: held 2.677s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (76f9619b-e19b-4139-9cae-59d5ea9d5a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8248fe-9cf7-4467-88b8-0a6debb7bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8248fe-9cf7-4467-88b8-0a6debb7bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-527665386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1299ade8-38df-48fc-8425-6b2b7f5d5523,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:35Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac9c9f6-84f0-4cb4-af75-5c814498aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac9c9f6-84f0-4cb4-af75-5c814498aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa85d6ef-fc3d-457d-984c-81f1206f0977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa85d6ef-fc3d-457d-984c-81f1206f0977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1299ade8-38df-48fc-8425-6b2b7f5d5523', 'volume_name': 'volume-1299ade8-38df-48fc-8425-6b2b7f5d5523', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebed8ea-53fd-473b-8b08-3994a477aeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebed8ea-53fd-473b-8b08-3994a477aeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80063957-2140-469b-ab80-380436c23609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:35 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Volume 1299ade8-38df-48fc-8425-6b2b7f5d5523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1299ade8-38df-48fc-8425-6b2b7f5d5523', 'volume_size': 1} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-527665386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1299ade8-38df-48fc-8425-6b2b7f5d5523,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3e5fccf277214b4aac2e90728410bc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:35Z,use_quota=True,user_id='d3e53c2c375944cc95d81739695c35db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Creating volume 1299ade8-38df-48fc-8425-6b2b7f5d5523 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:35 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 1073741824 Jul 23 03:27:35 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-982253ac-ee7a-4476-aaf6-529d4ff9b97b-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "cinder-982253ac-ee7a-4476-aaf6-529d4ff9b97b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Acquiring lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0504d6c-e6ec-4f5f-8f12-d634b968404e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:35 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:35 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 1073741824" returned: 0 in 0.674s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.484s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:36 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b Jul 23 03:27:36 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 Jul 23 03:27:36 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80063957-2140-469b-ab80-380436c23609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1299ade8-38df-48fc-8425-6b2b7f5d5523', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197b92f9-8f96-4ba6-9b3d-249b1b949ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:36 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-982253ac-ee7a-4476-aaf6-529d4ff9b97b" returned: 0 in 0.409s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Volume volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 (1299ade8-38df-48fc-8425-6b2b7f5d5523): created successfully Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197b92f9-8f96-4ba6-9b3d-249b1b949ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Flow 'volume_create_manager' (76f9619b-e19b-4139-9cae-59d5ea9d5a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "cinder-quobyte-982253ac-ee7a-4476-aaf6-529d4ff9b97b" released by "delete_volume" :: held 0.986s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0e7d1fe3-3f12-4a69-a253-130539bebb37 tempest-VolumesListTestJSON-1788427865 None] Created volume successfully. Jul 23 03:27:36 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Created reservations ['31052fd0-f17e-481f-819d-0d48460b7818', '13825167-902b-4b94-b8eb-dd58db770ccf', '8ea59376-9841-49d3-8be5-6be558258a97', '979183fa-ffdf-4227-bccb-54dc5c2bd235'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:37 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:37 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:37 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.488s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:37 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Deleted volume successfully. Jul 23 03:27:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8c896ea7-884c-4e21-9a83-2618b2eeb1aa tempest-VolumesExtendTest-1328034190 None] Lock "cinder-982253ac-ee7a-4476-aaf6-529d4ff9b97b-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-1299ade8-38df-48fc-8425-6b2b7f5d5523-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-1299ade8-38df-48fc-8425-6b2b7f5d5523-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-quobyte-1299ade8-38df-48fc-8425-6b2b7f5d5523" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-1299ade8-38df-48fc-8425-6b2b7f5d5523" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0a1ed-3bc1-4e53-a5e2-29cb2b03dadf]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:41 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 Jul 23 03:27:41 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:41 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523" returned: 0 in 0.497s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:41 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523 Jul 23 03:27:41 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1299ade8-38df-48fc-8425-6b2b7f5d5523" returned: 0 in 0.360s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-1299ade8-38df-48fc-8425-6b2b7f5d5523" released by "delete_volume" :: held 0.907s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Created reservations ['5ee73036-5e28-4a61-b3f1-703ddd78faba', '76cfde29-6659-4159-8c03-8509266adc03', '5275b57d-6e6a-4f65-9dab-8bc314da8e77', '9d86730b-1333-48f9-a43f-ebb58843baa2'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:42 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:42 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Deleted volume successfully. Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-e0e93585-0b41-4372-bc2b-45f5ff62ac9a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ed8246a5-0ca1-4a0c-ae51-c7468649e825 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-1299ade8-38df-48fc-8425-6b2b7f5d5523-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-e0e93585-0b41-4372-bc2b-45f5ff62ac9a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-quobyte-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b0c00-81d4-40fc-83aa-822ba18eb003]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a Jul 23 03:27:43 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Flow 'volume_create_manager' (f298058c-edb2-46f7-80f1-9bcfb1c7ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e6e8d6-2e8d-485f-8aaf-0a3d7c5fddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e6e8d6-2e8d-485f-8aaf-0a3d7c5fddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-892127044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf91c5b1-5cc1-422c-b744-88d0ded1557b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eef5e68ac23431c8448dc86d5c45399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:43Z,use_quota=True,user_id='047ea57b7c6e459782b091e9dedfbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1911e91-8e24-4a1a-8f8a-ae9f04a42b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1911e91-8e24-4a1a-8f8a-ae9f04a42b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb69817-a9d7-43e2-994e-be6f0497bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb69817-a9d7-43e2-994e-be6f0497bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf91c5b1-5cc1-422c-b744-88d0ded1557b', 'volume_name': 'volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b71094f-0314-4351-8a30-f8c941ea18d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b71094f-0314-4351-8a30-f8c941ea18d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea17d43-5a10-4e94-afde-b4854cd1194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Volume cf91c5b1-5cc1-422c-b744-88d0ded1557b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b', 'volume_size': 1} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-892127044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf91c5b1-5cc1-422c-b744-88d0ded1557b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eef5e68ac23431c8448dc86d5c45399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:43Z,use_quota=True,user_id='047ea57b7c6e459782b091e9dedfbcaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Creating volume cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:43 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:43 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b 1073741824 Jul 23 03:27:43 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Flow 'volume_create_manager' (b6176fbe-5975-433e-a297-c6e65554acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9945ee-8e01-4c73-af5d-39bc773db208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9945ee-8e01-4c73-af5d-39bc773db208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-229790845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e605263-38cc-4d50-9d9a-e7d18ad81f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2840a0535c84797bf78b3234d0545fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:43Z,use_quota=True,user_id='bd1beb803fd24957b0edf0efe4cdc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e745b1-b1b0-46d5-a425-ece1fc0c4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e745b1-b1b0-46d5-a425-ece1fc0c4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b2b9f5-ce66-410a-b69a-0bcc911a9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b2b9f5-ce66-410a-b69a-0bcc911a9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e605263-38cc-4d50-9d9a-e7d18ad81f19', 'volume_name': 'volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd667f25-aade-4848-a377-1d44b1fd3a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd667f25-aade-4848-a377-1d44b1fd3a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6daa60e-6c6e-40c6-b78e-a567726f6896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19', 'volume_size': 1} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:43 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" returned: 0 in 0.474s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a Jul 23 03:27:43 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-e0e93585-0b41-4372-bc2b-45f5ff62ac9a" released by "delete_volume" :: held 0.775s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:43 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b 1073741824" returned: 0 in 0.495s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Created reservations ['543bef6e-7362-4f38-be08-ebb81f71613e', 'dc89612d-e7a4-43b3-9a63-0c2ce81d9c48', '98270291-abbb-4f5c-9b67-de69b036b4ac', 'c1c72863-4536-4f4c-8d12-ad112bd01b13'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b Jul 23 03:27:43 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:44 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-541b1fb2-d275-42c9-be86-aed5e26add12-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:44 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-541b1fb2-d275-42c9-be86-aed5e26add12-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b" returned: 0 in 0.337s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-229790845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e605263-38cc-4d50-9d9a-e7d18ad81f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2840a0535c84797bf78b3234d0545fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:43Z,use_quota=True,user_id='bd1beb803fd24957b0edf0efe4cdc882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Creating volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:44 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 1073741824 Jul 23 03:27:44 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea17d43-5a10-4e94-afde-b4854cd1194c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff994777-52f9-4383-901f-8178c4402620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:44 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Volume volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b (cf91c5b1-5cc1-422c-b744-88d0ded1557b): created successfully Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff994777-52f9-4383-901f-8178c4402620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Flow 'volume_create_manager' (f298058c-edb2-46f7-80f1-9bcfb1c7ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:44 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-37b7c208-136b-490d-8862-eaad7b66accb tempest-SnapshotMetadataTestJSON-1729828884 None] Created volume successfully. Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "cinder-quobyte-541b1fb2-d275-42c9-be86-aed5e26add12" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Deleted volume successfully. Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49915aaa-37b3-4a60-a011-fa86c27bb8c0 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-e0e93585-0b41-4372-bc2b-45f5ff62ac9a-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-541b1fb2-d275-42c9-be86-aed5e26add12" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e4799-206d-4146-9f33-18822fc87b6a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 Jul 23 03:27:44 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 1073741824" returned: 0 in 0.476s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 Jul 23 03:27:44 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:44 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:44 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12 Jul 23 03:27:44 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:45 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6daa60e-6c6e-40c6-b78e-a567726f6896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caf1b54-5fa5-4ea2-9c8a-1e9dd12de5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:45 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-541b1fb2-d275-42c9-be86-aed5e26add12" returned: 0 in 0.309s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Volume volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 (8e605263-38cc-4d50-9d9a-e7d18ad81f19): created successfully Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caf1b54-5fa5-4ea2-9c8a-1e9dd12de5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Flow 'volume_create_manager' (b6176fbe-5975-433e-a297-c6e65554acba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-quobyte-541b1fb2-d275-42c9-be86-aed5e26add12" released by "delete_volume" :: held 0.747s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ba5f9179-fe18-4cf1-9046-14cef682cc45 tempest-VolumesSnapshotListTestJSON-1149359723 None] Created volume successfully. Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Created reservations ['598c4e59-76fb-4f33-aff7-7d15aa908259', '6acef481-a7ec-4bd3-8152-c8382c7f3ce0', 'dcf18c6f-fb80-4a7a-95a8-cca5cfcf6e0d', '496dd8cb-79a7-44e3-a77f-ea4a0417b5b1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:45 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Creating offline snapshot b5627c45-7f42-4000-8567-986ad28fe782 of volume cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed0ecb-3646-4ccc-aa1c-462075e7904f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Deleted volume successfully. Jul 23 03:27:45 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b Jul 23 03:27:45 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6569f751-07e6-463d-a46b-2dce1f291d48 tempest-VolumesListTestJSON-1788427865 None] Lock "cinder-541b1fb2-d275-42c9-be86-aed5e26add12-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:45 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 1G Jul 23 03:27:45 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:46 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 1G" returned: 0 in 0.594s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 Jul 23 03:27:46 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782" returned: 0 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 is being set with open permissions: ugo+rw Jul 23 03:27:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 Jul 23 03:27:46 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782" returned: 0 in 0.290s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info Jul 23 03:27:47 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info is being set with open permissions: ugo+rw Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info Jul 23 03:27:47 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.info" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.276s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:47 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Creating offline snapshot 97d30467-0627-4d83-99f6-54291b297af7 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:27:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fb3ae535-48e8-43a2-a936-a34f9d5be6dc tempest-SnapshotMetadataTestJSON-1729828884 None] Create snapshot completed successfully Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a389d73-7e54-4391-8e6c-9da19a81dbc9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 Jul 23 03:27:47 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:48 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:27:48 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:48 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 1G Jul 23 03:27:48 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:48 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 1G" returned: 0 in 0.572s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:48 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:27:48 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.505s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:49 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 is being set with open permissions: ugo+rw Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:49 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:27:49 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "cinder-b5627c45-7f42-4000-8567-986ad28fe782-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-b5627c45-7f42-4000-8567-986ad28fe782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "cinder-quobyte-b5627c45-7f42-4000-8567-986ad28fe782" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:49 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info Jul 23 03:27:49 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-b5627c45-7f42-4000-8567-986ad28fe782" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Deleting offline snapshot b5627c45-7f42-4000-8567-986ad28fe782 of volume cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] snapshot_file for this snap is: volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c03811-05ee-4d57-a66d-1314316c38ba]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 Jul 23 03:27:50 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info is being set with open permissions: ugo+rw Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info Jul 23 03:27:50 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3185b305-1c6c-472a-abe3-5eef892c3b28]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.info" returned: 0 in 0.258s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-003ea2dd-bf8e-40cf-86b6-46476b6bd0d3 tempest-VolumesSnapshotListTestJSON-1149359723 None] Create snapshot completed successfully Jul 23 03:27:50 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b Jul 23 03:27:50 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b" returned: 0 in 0.371s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:50 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 Jul 23 03:27:50 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Creating offline snapshot 7bd6e417-acc1-4af0-8927-dcd2329d7011 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fb9a93-4c2d-4137-9c6f-d9b4ebc4c61a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:51 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782" returned: 0 in 0.423s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:51 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782 Jul 23 03:27:51 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:51 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:27:51 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:51 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b.b5627c45-7f42-4000-8567-986ad28fe782" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-b5627c45-7f42-4000-8567-986ad28fe782" released by "_delete_snapshot" :: held 1.582s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" released by "delete_snapshot" :: held 1.613s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:51 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.393s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:51 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 1G Jul 23 03:27:51 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Created reservations ['631c77a4-c743-4340-a900-3c17a289cb4a', '963d08d9-fcb6-4bc7-8c25-09f3d989a8bb', '1dd3fc1c-945a-4320-bee3-98f906546cea', '92861de4-3619-48e1-828f-5b9d1f78bf4d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Delete snapshot completed successfully. Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a59835a9-1d72-47be-905c-9ee2f49f4ba6 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-b5627c45-7f42-4000-8567-986ad28fe782-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:51 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 1G" returned: 0 in 0.474s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:51 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:27:51 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "cinder-cf91c5b1-5cc1-422c-b744-88d0ded1557b-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-cf91c5b1-5cc1-422c-b744-88d0ded1557b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de734d7-719a-41cd-b190-a6b972787f9d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:52 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 is being set with open permissions: ugo+rw Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:52 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:27:52 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b Jul 23 03:27:52 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.272s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.581s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:52 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b Jul 23 03:27:52 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e246ca33-e03d-42aa-b539-34a0af312fcf tempest-VolumesSnapshotListTestJSON-1149359723 None] Create snapshot completed successfully Jul 23 03:27:52 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-cf91c5b1-5cc1-422c-b744-88d0ded1557b" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-quobyte-cf91c5b1-5cc1-422c-b744-88d0ded1557b" released by "delete_volume" :: held 0.749s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Created reservations ['a4ecf94b-3b5c-4e05-9d27-20eb1adaa6e8', 'e8698f0d-5139-4fdc-9397-3f90b0f2ec93', '0a2abaff-a42a-4bcd-b533-1575b1eba7ca', '563e51c7-c0b1-439b-acf9-6fd67a4d2442'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:53 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:27:53 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:53 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.464s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Deleted volume successfully. Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Creating offline snapshot cdb46dec-132b-4577-8b21-1ad3b9ff1583 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c4edf253-03ee-4685-9044-2f5873ae0794 tempest-SnapshotMetadataTestJSON-1729828884 None] Lock "cinder-cf91c5b1-5cc1-422c-b744-88d0ded1557b-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd08005-9e53-41b7-a9f6-928d7b422bd1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:53 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:27:53 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:54 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:54 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 1G Jul 23 03:27:54 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:54 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 1G" returned: 0 in 0.592s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:54 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 Jul 23 03:27:54 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:54 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583" returned: 0 in 0.347s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:54 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 is being set with open permissions: ugo+rw Jul 23 03:27:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:55 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 Jul 23 03:27:55 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:55 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583" returned: 0 in 0.302s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4cba0273-52b0-4bd3-8596-225d678561d8 tempest-VolumesSnapshotListTestJSON-1149359723 None] Create snapshot completed successfully Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-cdb46dec-132b-4577-8b21-1ad3b9ff1583-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-cdb46dec-132b-4577-8b21-1ad3b9ff1583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-cdb46dec-132b-4577-8b21-1ad3b9ff1583" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-cdb46dec-132b-4577-8b21-1ad3b9ff1583" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Deleting offline snapshot cdb46dec-132b-4577-8b21-1ad3b9ff1583 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] snapshot_file for this snap is: volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3281e45-bf81-4bd8-a6d1-a07dd629e571]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:56 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 Jul 23 03:27:56 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:57 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583" returned: 0 in 0.635s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7d599f-27d3-4fd2-97df-59e5ad856944]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:57 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:27:57 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:57 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.472s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:58 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 Jul 23 03:27:58 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:58 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583" returned: 0 in 0.592s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:58 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583 Jul 23 03:27:58 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:58 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.cdb46dec-132b-4577-8b21-1ad3b9ff1583" returned: 0 in 0.355s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-cdb46dec-132b-4577-8b21-1ad3b9ff1583" released by "_delete_snapshot" :: held 2.216s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" released by "delete_snapshot" :: held 2.240s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:59 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Created reservations ['e179ba8b-bff8-448b-8e02-63b6e6aa3fbb', 'cf827000-259c-42cb-965b-8fe287a30d9c', '2efd6393-5375-43a9-8125-20234195c8b7', 'd28c36e0-4a2b-463f-ad0a-739bb2a2109a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Delete snapshot completed successfully. Jul 23 03:27:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6e1735d1-db52-467a-8795-fc52343f8a88 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-cdb46dec-132b-4577-8b21-1ad3b9ff1583-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-7bd6e417-acc1-4af0-8927-dcd2329d7011-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-7bd6e417-acc1-4af0-8927-dcd2329d7011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-7bd6e417-acc1-4af0-8927-dcd2329d7011" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-7bd6e417-acc1-4af0-8927-dcd2329d7011" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Deleting offline snapshot 7bd6e417-acc1-4af0-8927-dcd2329d7011 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] snapshot_file for this snap is: volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49623c3-41f8-4e4f-a38e-b7de07878397]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:00 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:28:00 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:00 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.518s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3890b337-538f-4c6c-8d76-27a9667b45b1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:00 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:28:00 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Flow 'volume_create_manager' (d6da194b-2597-4a92-be14-c841b11dfaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b03a566-a38f-4da6-a6e2-f20857e90582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b03a566-a38f-4da6-a6e2-f20857e90582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2032396558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1061ed-f1a4-4fc4-a551-ec1dfb368b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63d25c3cd274d71b2210618435617d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:01Z,use_quota=True,user_id='bb0da370633143a4b8e254fc5c8acf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf068507-60bf-4bba-b646-3fb7900694ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf068507-60bf-4bba-b646-3fb7900694ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290c04e6-fa74-4ea8-8e5a-489895a73dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290c04e6-fa74-4ea8-8e5a-489895a73dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1061ed-f1a4-4fc4-a551-ec1dfb368b50', 'volume_name': 'volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2b2bc2-6f2f-40aa-a0c8-5cbc00d49f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2b2bc2-6f2f-40aa-a0c8-5cbc00d49f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5833d7c6-f8c9-4e80-aa77-989bf763b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Volume 8e1061ed-f1a4-4fc4-a551-ec1dfb368b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50', 'volume_size': 1} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2032396558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1061ed-f1a4-4fc4-a551-ec1dfb368b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63d25c3cd274d71b2210618435617d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:01Z,use_quota=True,user_id='bb0da370633143a4b8e254fc5c8acf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Creating volume 8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 1073741824 Jul 23 03:28:01 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.553s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:28:01 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 1073741824" returned: 0 in 0.553s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:01 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 Jul 23 03:28:01 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Flow 'volume_create_manager' (eb3abe04-e2cb-4d68-b0ca-70e02d625f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfec9d30-e10a-4eb1-b5a3-b2ecf784ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfec9d30-e10a-4eb1-b5a3-b2ecf784ed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1230016869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15033948-d731-4c23-95d2-b804e83df0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25cae52c1957472092cd41ea1ed21726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:02Z,use_quota=True,user_id='bfeda22fb40b4f1b8a727099f464a8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b729b44-3fb0-4090-8ef2-6b2fc531fea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b729b44-3fb0-4090-8ef2-6b2fc531fea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6812891d-396c-401b-9e95-0817c92d0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6812891d-396c-401b-9e95-0817c92d0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15033948-d731-4c23-95d2-b804e83df0a0', 'volume_name': 'volume-15033948-d731-4c23-95d2-b804e83df0a0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d7eb60-2cc4-4f08-9314-a6df9a18966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d7eb60-2cc4-4f08-9314-a6df9a18966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2e8660-8756-4b98-8ac1-2e2c329a7443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Volume 15033948-d731-4c23-95d2-b804e83df0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15033948-d731-4c23-95d2-b804e83df0a0', 'volume_size': 1} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:01 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (d0c468e1-57dd-4f58-bf5e-8631bb0d0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0ccbb7-3a95-4770-adc6-9762bcb49377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.467s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0ccbb7-3a95-4770-adc6-9762bcb49377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-931245812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d99bb74-5b58-4aae-b373-51a3044ea9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:02Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011 Jul 23 03:28:01 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a1ec57-08ca-4b49-8e0f-7a231990b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a1ec57-08ca-4b49-8e0f-7a231990b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22dad6f-8080-48e6-91fc-6a8b2243bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22dad6f-8080-48e6-91fc-6a8b2243bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d99bb74-5b58-4aae-b373-51a3044ea9ec', 'volume_name': 'volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefce00a-d627-4add-bbfe-035d8ff484c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefce00a-d627-4add-bbfe-035d8ff484c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c790fa-53b6-404b-9daf-d36178f9f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Volume 2d99bb74-5b58-4aae-b373-51a3044ea9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec', 'volume_size': 1} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:01 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1230016869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15033948-d731-4c23-95d2-b804e83df0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25cae52c1957472092cd41ea1ed21726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:02Z,use_quota=True,user_id='bfeda22fb40b4f1b8a727099f464a8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Creating volume 15033948-d731-4c23-95d2-b804e83df0a0 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5833d7c6-f8c9-4e80-aa77-989bf763b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 1073741824 Jul 23 03:28:01 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4318689-6136-4b65-943e-edff54e0d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Volume volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 (8e1061ed-f1a4-4fc4-a551-ec1dfb368b50): created successfully Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4318689-6136-4b65-943e-edff54e0d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Flow 'volume_create_manager' (d6da194b-2597-4a92-be14-c841b11dfaac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-900ac049-faa7-4769-999a-41053e9ac146 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Created volume successfully. Jul 23 03:28:02 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.7bd6e417-acc1-4af0-8927-dcd2329d7011" returned: 0 in 0.255s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-7bd6e417-acc1-4af0-8927-dcd2329d7011" released by "_delete_snapshot" :: held 1.938s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" released by "delete_snapshot" :: held 1.974s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Created reservations ['754ec0a5-68a4-4428-90e6-54b8fadc7c32', '808e67db-6be8-41e1-9713-8609bba7bb53', '4431318f-b73c-4655-b794-e7bbaf4508f9', '1a0b1987-7f56-4a42-aece-1674a490390b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Delete snapshot completed successfully. Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-01d4a520-3d25-4465-b490-a0d6a1fae763 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-7bd6e417-acc1-4af0-8927-dcd2329d7011-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-97d30467-0627-4d83-99f6-54291b297af7-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-97d30467-0627-4d83-99f6-54291b297af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-97d30467-0627-4d83-99f6-54291b297af7" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-97d30467-0627-4d83-99f6-54291b297af7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Deleting offline snapshot 97d30467-0627-4d83-99f6-54291b297af7 of volume 8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] snapshot_file for this snap is: volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:02 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 1073741824" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39aa7f2-cc72-40b9-b774-076f92ec67a3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:02 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 Jul 23 03:28:02 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:02 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:28:02 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:02 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-931245812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d99bb74-5b58-4aae-b373-51a3044ea9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:02Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Creating volume 2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:02 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2e8660-8756-4b98-8ac1-2e2c329a7443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15033948-d731-4c23-95d2-b804e83df0a0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:02 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec 1073741824 Jul 23 03:28:02 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef9f4e-c3df-48bf-bb06-39446e4058d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Volume volume-15033948-d731-4c23-95d2-b804e83df0a0 (15033948-d731-4c23-95d2-b804e83df0a0): created successfully Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ef9f4e-c3df-48bf-bb06-39446e4058d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Flow 'volume_create_manager' (eb3abe04-e2cb-4d68-b0ca-70e02d625f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1d0228e1-eaf5-4bb0-9641-efe903fcd878 tempest-AbsoluteLimitsTests-309373464 None] Created volume successfully. Jul 23 03:28:02 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3bf2b-d12e-4df5-ba02-f195eb949599]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 Jul 23 03:28:03 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec 1073741824" returned: 0 in 0.521s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19" returned: 0 in 0.414s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:28:03 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4ea45654-d4a6-4fe6-a9f6-f313476eb50e req-f16ac2e0-f48c-4005-9ecf-6b3680b1e38e tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec Jul 23 03:28:03 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4ea45654-d4a6-4fe6-a9f6-f313476eb50e req-f16ac2e0-f48c-4005-9ecf-6b3680b1e38e tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.301s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-4ea45654-d4a6-4fe6-a9f6-f313476eb50e req-f16ac2e0-f48c-4005-9ecf-6b3680b1e38e tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c790fa-53b6-404b-9daf-d36178f9f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8a14ec-b56b-42d4-aaf4-585f3d20e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:03 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-4ea45654-d4a6-4fe6-a9f6-f313476eb50e req-f16ac2e0-f48c-4005-9ecf-6b3680b1e38e tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dfa2519-de0d-4da3-8bda-50f91cf59813', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Acquiring lock "cinder-15033948-d731-4c23-95d2-b804e83df0a0-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.432s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Volume volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec (2d99bb74-5b58-4aae-b373-51a3044ea9ec): created successfully Jul 23 03:28:03 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7 Jul 23 03:28:03 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8a14ec-b56b-42d4-aaf4-585f3d20e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (d0c468e1-57dd-4f58-bf5e-8631bb0d0543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "cinder-15033948-d731-4c23-95d2-b804e83df0a0-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e503350c-a34a-4f83-aef6-9635c721776b tempest-VolumesSnapshotTestJSON-1084701213 None] Created volume successfully. Jul 23 03:28:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-4ea45654-d4a6-4fe6-a9f6-f313476eb50e req-f16ac2e0-f48c-4005-9ecf-6b3680b1e38e tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] attachment_update completed successfully. Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Acquiring lock "cinder-quobyte-15033948-d731-4c23-95d2-b804e83df0a0" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "cinder-quobyte-15033948-d731-4c23-95d2-b804e83df0a0" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09edae-2d06-48d1-958c-45e495753589]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:04 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19.97d30467-0627-4d83-99f6-54291b297af7" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-97d30467-0627-4d83-99f6-54291b297af7" released by "_delete_snapshot" :: held 1.701s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:04 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 Jul 23 03:28:04 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" released by "delete_snapshot" :: held 1.744s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Created reservations ['003b1a64-73a9-4b6e-af01-00b9c5d1a93a', '68972949-38f5-40f8-b3de-9b9cd1e8b2a5', 'fc02ac7d-a03a-478e-a286-31a840e032b6', 'a581718b-33b1-4c9e-bc92-3a3cc30f429f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Delete snapshot completed successfully. Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd55c791-3d9d-4260-b736-6e7b90c1a526 tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-97d30467-0627-4d83-99f6-54291b297af7-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:04 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0" returned: 0 in 0.405s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:04 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0 Jul 23 03:28:04 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-8e605263-38cc-4d50-9d9a-e7d18ad81f19-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-8e605263-38cc-4d50-9d9a-e7d18ad81f19-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:04 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-15033948-d731-4c23-95d2-b804e83df0a0" returned: 0 in 0.388s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[af46ba4e-4fbb-49d1-9918-99dc0f5422e2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "cinder-quobyte-15033948-d731-4c23-95d2-b804e83df0a0" released by "delete_volume" :: held 0.859s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Created reservations ['9d028c74-9a3f-4c25-9b87-78eae187f207', 'a2296760-f4e3-40e2-b908-fe528576fa2a', '397fea2d-7695-4865-a006-ea70d5e01ba4', '9162934b-b927-4d30-94ac-d3daa56d360b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:04 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 Jul 23 03:28:04 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:05 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating offline snapshot e7f8c918-0cf2-4b33-88ae-09a33e08ed6e of volume 2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3642230-8756-44af-9831-40a899e02825]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19" returned: 0 in 0.458s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19 Jul 23 03:28:05 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec Jul 23 03:28:05 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.309s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Deleted volume successfully. Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17d69469-0c59-434d-9734-0e94266cc0f6 tempest-AbsoluteLimitsTests-309373464 None] Lock "cinder-15033948-d731-4c23-95d2-b804e83df0a0-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:05 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e605263-38cc-4d50-9d9a-e7d18ad81f19" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-quobyte-8e605263-38cc-4d50-9d9a-e7d18ad81f19" released by "delete_volume" :: held 0.838s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:05 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec" returned: 0 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Created reservations ['dd4b183d-d8a9-4eec-bffb-cdd20930f141', '8b77803b-f228-47f0-8f7a-f6692c930e2c', 'f50c96eb-e3b2-4a50-8fb4-ceaff5e6e6a1', 'edcdad4c-46fb-4473-b7f3-3f5924f23545'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:05 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e 1G Jul 23 03:28:05 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:05 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.279s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Deleted volume successfully. Jul 23 03:28:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fddbac6-1aef-4ec3-ba41-1350e434b2fc tempest-VolumesSnapshotListTestJSON-1149359723 None] Lock "cinder-8e605263-38cc-4d50-9d9a-e7d18ad81f19-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:06 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e 1G" returned: 0 in 0.495s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e Jul 23 03:28:06 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e is being set with open permissions: ugo+rw Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e Jul 23 03:28:06 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info Jul 23 03:28:06 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info is being set with open permissions: ugo+rw Jul 23 03:28:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info Jul 23 03:28:07 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.info" returned: 0 in 0.398s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b3999ccc-3ebd-4066-ba38-c4aed1cb0143 tempest-VolumesSnapshotTestJSON-1084701213 None] Create snapshot completed successfully Jul 23 03:28:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-87993ea8-0579-4ac5-8872-8be942058aaa req-4bf40749-2869-41b4-8661-9f1da0af84b3 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Terminate volume connection completed successfully. Jul 23 03:28:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-87993ea8-0579-4ac5-8872-8be942058aaa req-4bf40749-2869-41b4-8661-9f1da0af84b3 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Deleting attachment 3dfa2519-de0d-4da3-8bda-50f91cf59813. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "cinder-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "cinder-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "cinder-quobyte-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "cinder-quobyte-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Deleting offline snapshot e7f8c918-0cf2-4b33-88ae-09a33e08ed6e of volume 2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] snapshot_file for this snap is: volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f3fbd-269b-49a0-81b3-503af09daea2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c20e4-09fe-4efc-95aa-d4a8eebfec86]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 Jul 23 03:28:08 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e Jul 23 03:28:08 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:09 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" returned: 0 in 0.454s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:09 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50 Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" returned: 0 in 0.473s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:09 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c0a8a-3a48-4cfd-8199-17d2a1f15e37]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:09 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec Jul 23 03:28:09 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:09 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" returned: 0 in 0.333s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "cinder-quobyte-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50" released by "delete_volume" :: held 0.912s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Created reservations ['9650ed95-d1aa-4a4f-b2ab-1d37c09d30eb', '883c6a9d-8607-4b29-9637-aa08a751a8bf', '76a3c90c-fe5a-402f-81ed-1671caa6947b', '41e11dba-5eb7-4e58-8d3e-0dbb2eac67a6'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:09 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec" returned: 0 in 0.464s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:09 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:09 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:09 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e Jul 23 03:28:09 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:10 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Deleted volume successfully. Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-eeff8a44-990f-4c89-8321-09ec82c62829 tempest-TestServerVolumeAttachScenarioOldVersion-557642209 None] Lock "cinder-8e1061ed-f1a4-4fc4-a551-ec1dfb368b50-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:10 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" returned: 0 in 0.506s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:10 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e Jul 23 03:28:10 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:10 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec.e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e" released by "_delete_snapshot" :: held 1.950s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" released by "delete_snapshot" :: held 2.000s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['3f9e70a0-ec51-45d8-a215-782b55d5aee4', '866257ed-0391-40f8-a958-a4e4a40ff260', '222d7a52-b274-4576-900e-e648c9db677e', '091eb087-fe76-4533-8e32-953cd0c98933'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Delete snapshot completed successfully. Jul 23 03:28:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-40c431c0-4706-44bd-8fa4-e0b6a2a381ef tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-e7f8c918-0cf2-4b33-88ae-09a33e08ed6e-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Flow 'volume_create_manager' (8306f9f1-e000-436c-8652-9b5eebdc9984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbbe75b-b202-45d2-8de7-c26a290ef2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbbe75b-b202-45d2-8de7-c26a290ef2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-929995933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0730d6b-d53f-4fd3-a251-21c7bff6d944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d670a406a984a0bb79a1c462068b3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:11Z,use_quota=True,user_id='1e9b9d648fd84b3ba5970d3264c2bcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48235614-5932-4151-abbc-4a54970a36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48235614-5932-4151-abbc-4a54970a36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f326cc-931f-41dd-a266-0f7f65ff68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f326cc-931f-41dd-a266-0f7f65ff68a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0730d6b-d53f-4fd3-a251-21c7bff6d944', 'volume_name': 'volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a49d38-c848-42a7-8ea2-1dc3648b1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a49d38-c848-42a7-8ea2-1dc3648b1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e95a902-c850-452b-9650-60dc4f6585c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Volume d0730d6b-d53f-4fd3-a251-21c7bff6d944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944', 'volume_size': 1} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-929995933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0730d6b-d53f-4fd3-a251-21c7bff6d944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d670a406a984a0bb79a1c462068b3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:11Z,use_quota=True,user_id='1e9b9d648fd84b3ba5970d3264c2bcbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Creating volume d0730d6b-d53f-4fd3-a251-21c7bff6d944 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:11 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 1073741824 Jul 23 03:28:11 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:12 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 1073741824" returned: 0 in 0.666s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:12 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 Jul 23 03:28:12 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (03b9a42d-533c-4b57-bfc0-da89596aa637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43505cf2-543a-4b3a-a62b-3af3b5b84ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43505cf2-543a-4b3a-a62b-3af3b5b84ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892797173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703136e-c637-4d78-8399-a0d2eef5ad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:13Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4cc9d6-4227-4590-b27a-52231b7b7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4cc9d6-4227-4590-b27a-52231b7b7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0399766-a069-405a-9d22-d586a26bee37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0399766-a069-405a-9d22-d586a26bee37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a703136e-c637-4d78-8399-a0d2eef5ad49', 'volume_name': 'volume-a703136e-c637-4d78-8399-a0d2eef5ad49', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e012be45-bf4c-473f-9c9d-19926ad27929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e012be45-bf4c-473f-9c9d-19926ad27929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d010c-ffcb-40d4-87e8-9f27e879571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume a703136e-c637-4d78-8399-a0d2eef5ad49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a703136e-c637-4d78-8399-a0d2eef5ad49', 'volume_size': 1} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:12 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892797173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703136e-c637-4d78-8399-a0d2eef5ad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:13Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating volume a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:12 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e95a902-c850-452b-9650-60dc4f6585c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420a20a-9011-454e-bf88-6d701e06c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:12 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 1073741824 Jul 23 03:28:12 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Volume volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 (d0730d6b-d53f-4fd3-a251-21c7bff6d944): created successfully Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420a20a-9011-454e-bf88-6d701e06c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Flow 'volume_create_manager' (8306f9f1-e000-436c-8652-9b5eebdc9984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7d2a65b7-d034-4d1f-b63f-5754c2147fe0 tempest-VolumesMetadataTest-720004485 None] Created volume successfully. Jul 23 03:28:13 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 1073741824" returned: 0 in 0.753s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:13 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:13 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:13 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.327s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d010c-ffcb-40d4-87e8-9f27e879571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a703136e-c637-4d78-8399-a0d2eef5ad49', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ca62ad-bdcf-45b3-93aa-356d156306f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:13 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume volume-a703136e-c637-4d78-8399-a0d2eef5ad49 (a703136e-c637-4d78-8399-a0d2eef5ad49): created successfully Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ca62ad-bdcf-45b3-93aa-356d156306f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (03b9a42d-533c-4b57-bfc0-da89596aa637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-42fc8afd-0a23-4194-be03-d7761d153e12 tempest-VolumesSnapshotTestJSON-1084701213 None] Created volume successfully. Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Acquiring lock "cinder-d0730d6b-d53f-4fd3-a251-21c7bff6d944-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "cinder-d0730d6b-d53f-4fd3-a251-21c7bff6d944-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Acquiring lock "cinder-quobyte-d0730d6b-d53f-4fd3-a251-21c7bff6d944" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "cinder-quobyte-d0730d6b-d53f-4fd3-a251-21c7bff6d944" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcfcaa3-9168-4bb8-a43c-2ef0c8b907b4]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:14 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 Jul 23 03:28:14 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Creating offline snapshot c3f572f0-3e47-477b-ba00-330344a65fc6 of volume a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f88043-5e16-4298-8899-322a25f5e20d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944" returned: 0 in 0.538s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:15 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:15 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944 Jul 23 03:28:15 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:15 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d0730d6b-d53f-4fd3-a251-21c7bff6d944" returned: 0 in 0.321s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "cinder-quobyte-d0730d6b-d53f-4fd3-a251-21c7bff6d944" released by "delete_volume" :: held 0.935s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:15 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 1G Jul 23 03:28:15 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Created reservations ['03f675b7-964e-4c68-8b16-a2e2bbd18f94', 'a760b8de-3860-4249-88a6-7b607a924b8a', '73d77755-e5c3-456e-bb2a-0ac3ad60fbdb', '596db4b5-bff9-441e-91f7-13c44c653af9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:15 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:16 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.301s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:16 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Deleted volume successfully. Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 1G" returned: 0 in 0.537s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a703136e-c637-4d78-8399-a0d2eef5ad49 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:16 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a703136e-c637-4d78-8399-a0d2eef5ad49 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:16 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-287f95a5-c95b-46d2-9253-60cdb3947b00 tempest-VolumesMetadataTest-720004485 None] Lock "cinder-d0730d6b-d53f-4fd3-a251-21c7bff6d944-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:16 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a703136e-c637-4d78-8399-a0d2eef5ad49 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 is being set with open permissions: ugo+rw Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:16 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:16 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:16 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.354s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:16 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info Jul 23 03:28:16 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:17 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:17 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info is being set with open permissions: ugo+rw Jul 23 03:28:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:17 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info Jul 23 03:28:17 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:17 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.info" returned: 0 in 0.342s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c8c64fe2-bc38-4c7f-8772-5a9bea21485e tempest-VolumesSnapshotTestJSON-1084701213 None] Create snapshot completed successfully Jul 23 03:28:18 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=181,cinder:SELECT=156,cinder:INSERT=46,cinder:DELETE=15 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:18 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (36df181d-56cb-4eaf-aa84-850969295e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b5f1c-a3e3-472e-bb03-38b01527608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b5f1c-a3e3-472e-bb03-38b01527608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1891357141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a65360-45e0-4f9b-adb9-4ebbf40ae85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c3f572f0-3e47-477b-ba00-330344a65fc6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:19Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a262ed-00db-4454-ad98-480ef6b6592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a262ed-00db-4454-ad98-480ef6b6592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac73bc9-df5b-4ebe-ad79-f6e3538f0bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac73bc9-df5b-4ebe-ad79-f6e3538f0bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66a65360-45e0-4f9b-adb9-4ebbf40ae85a', 'volume_name': 'volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a', 'volume_size': 2, 'snapshot_id': 'c3f572f0-3e47-477b-ba00-330344a65fc6'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a24584-11c2-44a9-be59-7e844f195a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a24584-11c2-44a9-be59-7e844f195a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a0b9c-f96d-4664-ae42-38b4683066b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume 66a65360-45e0-4f9b-adb9-4ebbf40ae85a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a', 'volume_size': 2, 'snapshot_id': 'c3f572f0-3e47-477b-ba00-330344a65fc6'} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating volume 66a65360-45e0-4f9b-adb9-4ebbf40ae85a from snapshot c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] snapshot: c3f572f0-3e47-477b-ba00-330344a65fc6, volume: 66a65360-45e0-4f9b-adb9-4ebbf40ae85a, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd15095-5cbe-42b3-bd28-55ffab4984b9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:19 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:19 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:19 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.607s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a703136e-c637-4d78-8399-a0d2eef5ad49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c5362-0151-42e2-8439-735016d3830c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:19 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:19 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:20 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.515s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:20 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:28:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:20 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a Jul 23 03:28:20 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:22 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=144,cinder:UPDATE=172,cinder:DELETE=15,cinder:INSERT=40 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (de1421dd-0779-442a-9eb9-e854fbf4b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2417c71-4418-4375-ab15-f36bd53a859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2417c71-4418-4375-ab15-f36bd53a859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1672947491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d5b06f-faf1-44c4-aee4-22273c1f903c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:23Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3065c4c8-2560-4c6a-ab2a-8d08d63b14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3065c4c8-2560-4c6a-ab2a-8d08d63b14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e09d6a-5ef3-485b-aa9b-8cb28ae40135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e09d6a-5ef3-485b-aa9b-8cb28ae40135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d5b06f-faf1-44c4-aee4-22273c1f903c', 'volume_name': 'volume-87d5b06f-faf1-44c4-aee4-22273c1f903c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053e5511-455e-4600-b283-e05143eb20d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053e5511-455e-4600-b283-e05143eb20d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33b5fe6-5b9b-4075-b41a-c824ec3754e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:23 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Volume 87d5b06f-faf1-44c4-aee4-22273c1f903c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d5b06f-faf1-44c4-aee4-22273c1f903c', 'volume_size': 1} Jul 23 03:28:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:25 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" returned: 0 in 5.421s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e8ed7-47cf-4ff8-b5d9-46ad268a0375]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:25 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:25 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:26 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.598s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:26 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Converted 1024.00 MB image at 188.88 MB/s Jul 23 03:28:26 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a is being set with open permissions: ugo+rw Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:26 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a Jul 23 03:28:26 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:26 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" returned: 0 in 0.300s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" released by "_copy_volume_from_snapshot" :: held 7.591s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" released by "_create_volume_from_snapshot" :: held 7.628s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.646s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1672947491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d5b06f-faf1-44c4-aee4-22273c1f903c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:23Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Creating volume 87d5b06f-faf1-44c4-aee4-22273c1f903c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:26 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:26 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c 1073741824 Jul 23 03:28:26 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a0b9c-f96d-4664-ae42-38b4683066b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a', 'volume_size': 2, 'snapshot_id': 'c3f572f0-3e47-477b-ba00-330344a65fc6'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be382d09-e92d-45e8-8e57-198b3ec3f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:26 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a (66a65360-45e0-4f9b-adb9-4ebbf40ae85a): created successfully Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be382d09-e92d-45e8-8e57-198b3ec3f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:26 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (36df181d-56cb-4eaf-aa84-850969295e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8f1212c4-8fb8-487a-acbe-7f8821b8cdc2 tempest-VolumesSnapshotTestJSON-1084701213 None] Created volume successfully. Jul 23 03:28:27 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c 1073741824" returned: 0 in 0.609s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:27 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c Jul 23 03:28:27 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:27 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33b5fe6-5b9b-4075-b41a-c824ec3754e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d5b06f-faf1-44c4-aee4-22273c1f903c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91386959-aab8-4f3d-bfcd-ad908d2cb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:27 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Volume volume-87d5b06f-faf1-44c4-aee4-22273c1f903c (87d5b06f-faf1-44c4-aee4-22273c1f903c): created successfully Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91386959-aab8-4f3d-bfcd-ad908d2cb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (de1421dd-0779-442a-9eb9-e854fbf4b680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-aa2d3051-4b6c-4498-ab09-f66cfe24772c tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-66a65360-45e0-4f9b-adb9-4ebbf40ae85a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-66a65360-45e0-4f9b-adb9-4ebbf40ae85a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[259932bf-9dda-4ab2-b281-bcf827cc0d0d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:28 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a Jul 23 03:28:28 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:28 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:28 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a Jul 23 03:28:28 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-66a65360-45e0-4f9b-adb9-4ebbf40ae85a" released by "delete_volume" :: held 0.883s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['5fda478f-a00a-4209-884d-b4838e864ce6', '09cd5f43-ab36-4d3d-b0bd-bae3d3a8d19f', 'e5b653d9-86db-4800-9649-08ccf55d2c84', 'ab17e06b-2468-4955-83ac-930258b7f37b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:29 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (b8522965-4550-4db3-9504-f7f928e9365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf953606-965b-4a92-8eaa-c2cc4c296db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:29 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Deleted volume successfully. Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf953606-965b-4a92-8eaa-c2cc4c296db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-316537914',display_name='tempest-VolumesGetTest-Volume-752883010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505f0a1-00f8-4f23-9e34-9b0f44695de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:30Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7ed6a3-c3c6-4454-86cd-1cd67e579bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7ed6a3-c3c6-4454-86cd-1cd67e579bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4aa018-1497-4996-83a5-c788572b4f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4aa018-1497-4996-83a5-c788572b4f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9505f0a1-00f8-4f23-9e34-9b0f44695de7', 'volume_name': 'volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757fe87a-d2f5-4ff5-addf-b65e51850185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757fe87a-d2f5-4ff5-addf-b65e51850185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e560386c-e8d5-4e06-98ce-494e49dc5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:29 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Volume 9505f0a1-00f8-4f23-9e34-9b0f44695de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7', 'volume_size': 1} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-316537914',display_name='tempest-VolumesGetTest-Volume-752883010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9505f0a1-00f8-4f23-9e34-9b0f44695de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:30Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Creating volume 9505f0a1-00f8-4f23-9e34-9b0f44695de7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:29 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:29 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 1073741824 Jul 23 03:28:29 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cc55e044-11a3-42be-bfb5-cf6cd05f8ccb tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-66a65360-45e0-4f9b-adb9-4ebbf40ae85a-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:30 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 1073741824" returned: 0 in 0.554s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:30 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 Jul 23 03:28:30 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-c3f572f0-3e47-477b-ba00-330344a65fc6-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-c3f572f0-3e47-477b-ba00-330344a65fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Deleting offline snapshot c3f572f0-3e47-477b-ba00-330344a65fc6 of volume a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] snapshot_file for this snap is: volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907f198-e7ff-42e8-b59a-6bdc79c98863]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:30 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e560386c-e8d5-4e06-98ce-494e49dc5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092b9124-fa0c-43b9-bbb8-11137c82be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:30 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Volume volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 (9505f0a1-00f8-4f23-9e34-9b0f44695de7): created successfully Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092b9124-fa0c-43b9-bbb8-11137c82be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:30 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (b8522965-4550-4db3-9504-f7f928e9365d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:30 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:30 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a14a6cb5-023a-4e8c-b44c-5e12b73eb6c9 tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:28:31 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.513s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a703136e-c637-4d78-8399-a0d2eef5ad49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e89b2-9dcd-4e86-b420-fc98899a49f3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:31 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:31 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:31 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.425s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:31 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:31 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-9505f0a1-00f8-4f23-9e34-9b0f44695de7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:31 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-9505f0a1-00f8-4f23-9e34-9b0f44695de7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-9505f0a1-00f8-4f23-9e34-9b0f44695de7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-9505f0a1-00f8-4f23-9e34-9b0f44695de7" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e9bc0-e9b5-4205-8eaf-4cdca96da245]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:32 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 Jul 23 03:28:32 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:32 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.531s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:32 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6 Jul 23 03:28:32 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:32 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49.c3f572f0-3e47-477b-ba00-330344a65fc6" returned: 0 in 0.296s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:32 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7" returned: 0 in 0.584s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-c3f572f0-3e47-477b-ba00-330344a65fc6" released by "_delete_snapshot" :: held 1.912s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" released by "delete_snapshot" :: held 1.949s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:32 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7 Jul 23 03:28:32 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['33314273-ebb8-4241-8135-167b95ee9d87', '849266d9-dd1a-4214-a4de-8a58dae323c7', '4212f63f-d096-4d73-99c1-3f30b2ce6ff4', 'ce5c2a51-f472-4fd2-87a4-3d6f339b55bc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:32 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Delete snapshot completed successfully. Jul 23 03:28:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38d3542e-7e42-42d7-b088-b332270317ae tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-c3f572f0-3e47-477b-ba00-330344a65fc6-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:33 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9505f0a1-00f8-4f23-9e34-9b0f44695de7" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-9505f0a1-00f8-4f23-9e34-9b0f44695de7" released by "delete_volume" :: held 0.983s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Created reservations ['0bf19926-869a-4e64-9dd0-434a1d9bd1ba', 'bd82e784-dd3f-4e52-8b9d-5b559e6bd888', 'cdf35cc7-18a0-4d72-bb44-0a6d7d0d5e74', 'cd9a53c0-e165-4c7e-b6f9-fbb019cc4357'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:33 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:33 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:33 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.301s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:28:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4901426c-8de5-469a-b6b1-b2f325f042a9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-9505f0a1-00f8-4f23-9e34-9b0f44695de7-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-a703136e-c637-4d78-8399-a0d2eef5ad49-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-a703136e-c637-4d78-8399-a0d2eef5ad49-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-87d5b06f-faf1-44c4-aee4-22273c1f903c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "cinder-87d5b06f-faf1-44c4-aee4-22273c1f903c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[88daa15b-c9d3-4778-8273-3533a9906db5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-87d5b06f-faf1-44c4-aee4-22273c1f903c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-87d5b06f-faf1-44c4-aee4-22273c1f903c" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c380e-214a-4170-9734-f5a6225f1414]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:34 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:34 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:34 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c Jul 23 03:28:34 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.526s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49 Jul 23 03:28:35 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c Jul 23 03:28:35 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-87d5b06f-faf1-44c4-aee4-22273c1f903c" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-87d5b06f-faf1-44c4-aee4-22273c1f903c" released by "delete_volume" :: held 0.882s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:35 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a703136e-c637-4d78-8399-a0d2eef5ad49" returned: 0 in 0.437s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-a703136e-c637-4d78-8399-a0d2eef5ad49" released by "delete_volume" :: held 1.083s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Created reservations ['f3a591c6-2d87-4515-9a14-b63158f9fab7', 'e43095f4-d858-412a-9d5a-af22e96aa7ba', '31740839-48e2-4e1d-8643-a0e3c2e9b8dc', '47b4ed58-a435-4471-b5d1-e0955de37733'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['996869d9-bc5f-4e80-addb-7dbf4d2345cc', 'cd5fab38-32cb-48be-98c6-2180f0bc0928', '64b4f6f2-2a87-49dd-a7fb-0b78a7dc654b', 'e9769292-5e66-49d4-bb17-b876a173929c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:35 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:35 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:35 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:36 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.355s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-190cdfb0-5f5f-4fad-a057-2f90b322d16f tempest-VolumesGetTest-1301419278 None] Lock "cinder-87d5b06f-faf1-44c4-aee4-22273c1f903c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:36 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.360s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Deleted volume successfully. Jul 23 03:28:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c1897847-960d-4868-ad91-4f15c5a5eebe tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-a703136e-c637-4d78-8399-a0d2eef5ad49-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (d1b1aefc-a738-4c1c-9559-851d8d2b8396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43766b1e-989c-407d-a36f-36c02586bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43766b1e-989c-407d-a36f-36c02586bf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594069615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b6889d-ef4b-4fac-b2ee-353f19f4ddcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:37Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101734c1-494b-4d28-b4b0-596a1b184377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101734c1-494b-4d28-b4b0-596a1b184377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241ba486-5cf0-450a-af7b-aa76f76db710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241ba486-5cf0-450a-af7b-aa76f76db710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b6889d-ef4b-4fac-b2ee-353f19f4ddcb', 'volume_name': 'volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccb1ec-29f2-4ed2-aaff-77a3f2383c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccb1ec-29f2-4ed2-aaff-77a3f2383c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfab798-97e4-4a82-99f3-d747b2256a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume 13b6889d-ef4b-4fac-b2ee-353f19f4ddcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb', 'volume_size': 1} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594069615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b6889d-ef4b-4fac-b2ee-353f19f4ddcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:37Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating volume 13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:37 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:37 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb 1073741824 Jul 23 03:28:37 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (2fb9e8a0-9b30-4827-9a23-b8489194b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713cd868-d9f7-42d8-8403-099565e8eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713cd868-d9f7-42d8-8403-099565e8eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-874237649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10561271-57b0-4d1c-b741-482e371f89c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:37Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61dadc-0112-47b1-a8bd-87e3ffb5ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61dadc-0112-47b1-a8bd-87e3ffb5ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5877737d-50f2-4a57-9f38-561b61db9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5877737d-50f2-4a57-9f38-561b61db9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10561271-57b0-4d1c-b741-482e371f89c8', 'volume_name': 'volume-10561271-57b0-4d1c-b741-482e371f89c8', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd9f5bf-9f4e-416d-a30b-eef0a1e15d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd9f5bf-9f4e-416d-a30b-eef0a1e15d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3ca90c-181a-41a4-a21f-0f34e9cbedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Volume 10561271-57b0-4d1c-b741-482e371f89c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10561271-57b0-4d1c-b741-482e371f89c8', 'volume_size': 1} Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:37 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb 1073741824" returned: 0 in 0.604s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:38 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:28:38 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:38 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-874237649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10561271-57b0-4d1c-b741-482e371f89c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:37Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Creating volume 10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:38 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfab798-97e4-4a82-99f3-d747b2256a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:38 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 1073741824 Jul 23 03:28:38 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442219ab-04d9-4c24-849c-ac3663b2173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb (13b6889d-ef4b-4fac-b2ee-353f19f4ddcb): created successfully Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442219ab-04d9-4c24-849c-ac3663b2173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (d1b1aefc-a738-4c1c-9559-851d8d2b8396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a15c3ac0-a409-4e5e-a322-6575282fc039 tempest-VolumesSnapshotTestJSON-1084701213 None] Created volume successfully. Jul 23 03:28:38 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 1073741824" returned: 0 in 0.588s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:38 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Flow 'volume_create_manager' (36b3806b-fc6f-4371-9eda-13547326999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a38b79-4eb0-4b0b-90a5-45941671dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a38b79-4eb0-4b0b-90a5-45941671dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26343340-a33b-4ca0-8657-5b53cd64eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fb9e898bce48e782b34d3599d4f41d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:39Z,use_quota=True,user_id='11df434da68d4c83b528c1052dfd8535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da554c3c-c593-458c-8cd7-fb5a897011a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da554c3c-c593-458c-8cd7-fb5a897011a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae48dc-5837-4cb1-b706-f15f12e8e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:39 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:28:39 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:39 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3ca90c-181a-41a4-a21f-0f34e9cbedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10561271-57b0-4d1c-b741-482e371f89c8', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37120e6b-3dc2-4a4b-8988-05fa8efd44f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Volume volume-10561271-57b0-4d1c-b741-482e371f89c8 (10561271-57b0-4d1c-b741-482e371f89c8): created successfully Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37120e6b-3dc2-4a4b-8988-05fa8efd44f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (2fb9e8a0-9b30-4827-9a23-b8489194b564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae48dc-5837-4cb1-b706-f15f12e8e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26343340-a33b-4ca0-8657-5b53cd64eebf', 'volume_name': 'volume-26343340-a33b-4ca0-8657-5b53cd64eebf', 'volume_size': 1, 'image_id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a6895bdebaaabee5da919fc4c911e52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1fb9e898bce48e782b34d3599d4f41d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bbb3336d542ade673e4fc81ddaca18d0e4e1d07877bdf028bf596e5b49e5ead73cd90752b23e40a5e5840bbb2c6db6ef3e89dd8eac6853f3f2ec505c960d0eb', 'id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'created_at': datetime.datetime(2026, 7, 23, 1, 28, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 28, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49836932-aa25-44ae-8bbe-94a4e85d32d9/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5f9464-3d37-42df-8ff3-e5d7a17c3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5f9464-3d37-42df-8ff3-e5d7a17c3469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07688fca-94f1-4b51-9164-d49efe38622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:39 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Volume 26343340-a33b-4ca0-8657-5b53cd64eebf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26343340-a33b-4ca0-8657-5b53cd64eebf', 'volume_size': 1, 'image_id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a6895bdebaaabee5da919fc4c911e52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1fb9e898bce48e782b34d3599d4f41d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bbb3336d542ade673e4fc81ddaca18d0e4e1d07877bdf028bf596e5b49e5ead73cd90752b23e40a5e5840bbb2c6db6ef3e89dd8eac6853f3f2ec505c960d0eb', 'id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'created_at': datetime.datetime(2026, 7, 23, 1, 28, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 28, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49836932-aa25-44ae-8bbe-94a4e85d32d9/file', 'properties': {}}, 'image_service': } Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Trying to clone 26343340-a33b-4ca0-8657-5b53cd64eebf from image 49836932-aa25-44ae-8bbe-94a4e85d32d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:28:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ab6a9dd3-8ba5-47bd-853b-f21736dbff6a tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating offline snapshot b1c8b26e-dfb1-4ec8-9110-c335c99c4aea of volume 13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a330f8-0af7-4956-9a9c-15c198134778]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:28:39 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:28:39 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:28:39 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6770204d-a5a6-4e27-b07e-f2d8e345bdf9]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:39 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:39 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:40 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.446s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:40 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea 1G Jul 23 03:28:40 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:40 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:40 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:40 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:40 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Temporary image 49836932-aa25-44ae-8bbe-94a4e85d32d9 is fetched for user 11df434da68d4c83b528c1052dfd8535. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:28:40 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea 1G" returned: 0 in 0.537s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:40 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:28:40 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[569ae3fe-f099-4c8d-b35f-c6e9900da938]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:40 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:40 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:41 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:41 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.559s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:41 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea is being set with open permissions: ugo+rw Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:41 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:28:41 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:41 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:41 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (76df3b15-004f-4c26-bfb4-c7d129f6b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b04c35-6b02-4f3a-bf72-36f96b785f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b04c35-6b02-4f3a-bf72-36f96b785f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707620816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acc053f-9eab-4c49-b98f-5498b08aecb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=10561271-57b0-4d1c-b741-482e371f89c8,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:41Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c3c204-cf0e-4384-9e11-060a248c2696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c3c204-cf0e-4384-9e11-060a248c2696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa268529-96b3-41d7-a215-c820428e6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa268529-96b3-41d7-a215-c820428e6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4acc053f-9eab-4c49-b98f-5498b08aecb6', 'volume_name': 'volume-4acc053f-9eab-4c49-b98f-5498b08aecb6', 'volume_size': 1, 'source_volid': '10561271-57b0-4d1c-b741-482e371f89c8', 'source_volstatus': 'available'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb1003a-4fe3-435b-abfa-ae3736e257ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb1003a-4fe3-435b-abfa-ae3736e257ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b55ae6-ed0c-4598-9d1b-9c5d7f18a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Volume 4acc053f-9eab-4c49-b98f-5498b08aecb6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4acc053f-9eab-4c49-b98f-5498b08aecb6', 'volume_size': 1, 'source_volid': '10561271-57b0-4d1c-b741-482e371f89c8', 'source_volstatus': 'available'} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:41 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.305s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:41 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:41 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info Jul 23 03:28:41 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:41 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info" returned: 0 in 0.267s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:41 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info is being set with open permissions: ugo+rw Jul 23 03:28:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:41 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info Jul 23 03:28:41 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:42 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.info" returned: 0 in 0.298s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.663s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:42 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Cloning volume 10561271-57b0-4d1c-b741-482e371f89c8 to volume 4acc053f-9eab-4c49-b98f-5498b08aecb6 Jul 23 03:28:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-94cac3ca-85fa-42d7-b010-79e8c87b6279 tempest-VolumesSnapshotTestJSON-1084701213 None] Create snapshot completed successfully Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Creating offline snapshot a5bfedf1-ea3d-466d-bc78-8329e80a11ea of volume 10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2823d0e-5dfa-4fbf-bc06-209653e04a9f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:42 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:28:42 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:42 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:42 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea 1G Jul 23 03:28:42 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:42 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Flow 'volume_create_manager' (2d452b16-fd1a-47d0-b09b-7d0d427bac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af9ea4e-16a7-45c2-bcfe-401518803898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af9ea4e-16a7-45c2-bcfe-401518803898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2091119678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4becfb-7748-45e8-a6a6-a22969fe0020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a24b117d114c9e80c88295be9e52a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:43Z,use_quota=True,user_id='c36f1b31e6f94154b52b80388b22c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499593e9-3ef9-48cd-94f4-a524bb868c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499593e9-3ef9-48cd-94f4-a524bb868c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d58752-ff14-4344-9eaf-3d76f4b679c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d58752-ff14-4344-9eaf-3d76f4b679c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4becfb-7748-45e8-a6a6-a22969fe0020', 'volume_name': 'volume-0e4becfb-7748-45e8-a6a6-a22969fe0020', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7522a1b2-3b92-44bf-b87d-e833ba0a120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7522a1b2-3b92-44bf-b87d-e833ba0a120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e32b738-4b26-41a9-81a6-f19f78506fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume 0e4becfb-7748-45e8-a6a6-a22969fe0020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4becfb-7748-45e8-a6a6-a22969fe0020', 'volume_size': 1} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:43 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea 1G" returned: 0 in 0.658s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10561271-57b0-4d1c-b741-482e371f89c8 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:43 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10561271-57b0-4d1c-b741-482e371f89c8 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:43 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (ac47ea8f-9db3-41ea-afc6-602933844e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d4e491-e452-4532-bdaf-9f3769d73b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d4e491-e452-4532-bdaf-9f3769d73b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1814205806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc46406-9da4-4790-ac2e-a8703316edf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b068510bfa2a46cb87d59a1186508e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1c8b26e-dfb1-4ec8-9110-c335c99c4aea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:44Z,use_quota=True,user_id='40b50122d9ba4fd1868a8c9b3d6fc781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7adc73-6b99-4ae1-ae7f-82604fb7f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7adc73-6b99-4ae1-ae7f-82604fb7f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc89f9d5-d7f6-4242-b9a5-c87e6f5dd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc89f9d5-d7f6-4242-b9a5-c87e6f5dd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcc46406-9da4-4790-ac2e-a8703316edf7', 'volume_name': 'volume-bcc46406-9da4-4790-ac2e-a8703316edf7', 'volume_size': 1, 'snapshot_id': 'b1c8b26e-dfb1-4ec8-9110-c335c99c4aea'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9dbb2b-2c5d-498d-a8a7-808de1308f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9dbb2b-2c5d-498d-a8a7-808de1308f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffb1a0-82f1-4cb3-95d9-a69fdf9aa80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume bcc46406-9da4-4790-ac2e-a8703316edf7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcc46406-9da4-4790-ac2e-a8703316edf7', 'volume_size': 1, 'snapshot_id': 'b1c8b26e-dfb1-4ec8-9110-c335c99c4aea'} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Flow 'volume_create_manager' (0c43016d-3ef9-4fb0-9f3b-5a9305b960b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53e3e4b-0bca-462b-aadc-6e0b3b1db7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10561271-57b0-4d1c-b741-482e371f89c8 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.417s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:43 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea is being set with open permissions: ugo+rw Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:43 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:43 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53e3e4b-0bca-462b-aadc-6e0b3b1db7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1318148342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67408e2a-a2af-4baf-a950-4f784956b5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a24b117d114c9e80c88295be9e52a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:44Z,use_quota=True,user_id='c36f1b31e6f94154b52b80388b22c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996ee153-8f5e-4d2f-9c21-d14740595a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996ee153-8f5e-4d2f-9c21-d14740595a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cff9d09-16eb-43dd-968c-4496b3a09ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cff9d09-16eb-43dd-968c-4496b3a09ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67408e2a-a2af-4baf-a950-4f784956b5eb', 'volume_name': 'volume-67408e2a-a2af-4baf-a950-4f784956b5eb', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04316ce7-951a-4bc3-9a88-f99170861076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04316ce7-951a-4bc3-9a88-f99170861076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6c1c4c-4eac-47b5-950a-4deae1a2cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume 67408e2a-a2af-4baf-a950-4f784956b5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67408e2a-a2af-4baf-a950-4f784956b5eb', 'volume_size': 1} Jul 23 03:28:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:44 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:44 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info Jul 23 03:28:44 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:44 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:44 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info is being set with open permissions: ugo+rw Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:44 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info Jul 23 03:28:44 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:44 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.info" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] snapshot: a5bfedf1-ea3d-466d-bc78-8329e80a11ea, volume: 4acc053f-9eab-4c49-b98f-5498b08aecb6, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14c76f-f310-452c-9643-f040a2df5e22]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:44 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:44 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:45 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10561271-57b0-4d1c-b741-482e371f89c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc09faa8-acf3-4fcd-915e-bd423a61d756]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:45 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:28:45 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:45 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.428s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:28:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:45 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 Jul 23 03:28:45 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:47 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:28:47 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:48 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.650s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:28:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:28:50 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6" returned: 0 in 5.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[356d8319-5a50-4ee3-9d3a-951bf9a2214e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:51 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:28:51 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:51 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.635s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:51 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Converted 1024.00 MB image at 190.48 MB/s Jul 23 03:28:51 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 is being set with open permissions: ugo+rw Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:51 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 Jul 23 03:28:51 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:51 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6" returned: 0 in 0.259s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" released by "_copy_volume_from_snapshot" :: held 7.176s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-a5bfedf1-ea3d-466d-bc78-8329e80a11ea" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-a5bfedf1-ea3d-466d-bc78-8329e80a11ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Deleting offline snapshot a5bfedf1-ea3d-466d-bc78-8329e80a11ea of volume 10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] snapshot_file for this snap is: volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c042a02-a5a6-4d58-b0fe-655955bc9015]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:52 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:52 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:52 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.430s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10561271-57b0-4d1c-b741-482e371f89c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee1b534-d4ee-4e2e-89f4-c95d153de11c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:52 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:28:52 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:52 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.443s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:52 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:52 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:53 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.568s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:53 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea Jul 23 03:28:53 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:53 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8.a5bfedf1-ea3d-466d-bc78-8329e80a11ea" returned: 0 in 0.430s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-a5bfedf1-ea3d-466d-bc78-8329e80a11ea" released by "_delete_snapshot" :: held 2.012s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.764s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.344s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26343340-a33b-4ca0-8657-5b53cd64eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fb9e898bce48e782b34d3599d4f41d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:39Z,use_quota=True,user_id='11df434da68d4c83b528c1052dfd8535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Creating volume 26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:53 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b55ae6-ed0c-4598-9d1b-9c5d7f18a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acc053f-9eab-4c49-b98f-5498b08aecb6', 'volume_size': 1, 'source_volid': '10561271-57b0-4d1c-b741-482e371f89c8', 'source_volstatus': 'available'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:54 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1073741824 Jul 23 03:28:54 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31edef51-3ca4-4ad9-b846-b8f7ca491897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Volume volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 (4acc053f-9eab-4c49-b98f-5498b08aecb6): created successfully Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31edef51-3ca4-4ad9-b846-b8f7ca491897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (76df3b15-004f-4c26-bfb4-c7d129f6b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-37bf2bf5-ce0d-4cc3-8f0a-5016133f0d21 tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:28:54 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1073741824" returned: 0 in 0.605s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf Jul 23 03:28:54 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:54 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.786s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2091119678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4becfb-7748-45e8-a6a6-a22969fe0020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a24b117d114c9e80c88295be9e52a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:43Z,use_quota=True,user_id='c36f1b31e6f94154b52b80388b22c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Creating volume 0e4becfb-7748-45e8-a6a6-a22969fe0020 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:54 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:54 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Attempting download of 49836932-aa25-44ae-8bbe-94a4e85d32d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}])) to volume 26343340-a33b-4ca0-8657-5b53cd64eebf. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:28:54 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 1073741824 Jul 23 03:28:54 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9918e-61ab-4fce-a0a3-3c0bce68a48c]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb Jul 23 03:28:55 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb" returned: 0 in 0.488s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 1073741824" returned: 0 in 0.681s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:55 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 Jul 23 03:28:55 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb Jul 23 03:28:55 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (460b38e4-7974-453d-9bc2-0ea847d4aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27931110-b5d4-4dc2-9332-6960d9118db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27931110-b5d4-4dc2-9332-6960d9118db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-85287571',display_name='tempest-VolumesGetTest-Volume-873730398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422f4598-4816-4b2a-90fc-bac163fa7373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:56Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66499fc2-8858-483b-944f-00cb9a1af75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66499fc2-8858-483b-944f-00cb9a1af75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88913a91-de93-43c9-9ed9-d57ba6c0bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88913a91-de93-43c9-9ed9-d57ba6c0bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422f4598-4816-4b2a-90fc-bac163fa7373', 'volume_name': 'volume-422f4598-4816-4b2a-90fc-bac163fa7373', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a5cca9-a2f4-42c9-9bd1-bbd39fc8d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a5cca9-a2f4-42c9-9bd1-bbd39fc8d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4937798-e1b3-44cc-b126-308258dc05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Volume 422f4598-4816-4b2a-90fc-bac163fa7373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422f4598-4816-4b2a-90fc-bac163fa7373', 'volume_size': 1} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:56 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb" returned: 1 in 0.589s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49836932-aa25-44ae-8bbe-94a4e85d32d9_fkygv7cb' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[575bff64-fe78-4e44-8406-be50bf5aecb3]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020" returned: 0 in 0.519s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.361s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-bcc46406-9da4-4790-ac2e-a8703316edf7" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e32b738-4b26-41a9-81a6-f19f78506fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4becfb-7748-45e8-a6a6-a22969fe0020', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41bb7d-662c-4a84-9aa4-343408155871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-bcc46406-9da4-4790-ac2e-a8703316edf7" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating volume bcc46406-9da4-4790-ac2e-a8703316edf7 from snapshot b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] snapshot: b1c8b26e-dfb1-4ec8-9110-c335c99c4aea, volume: bcc46406-9da4-4790-ac2e-a8703316edf7, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:28:56 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:56 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 (0e4becfb-7748-45e8-a6a6-a22969fe0020): created successfully Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41bb7d-662c-4a84-9aa4-343408155871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Flow 'volume_create_manager' (2d452b16-fd1a-47d0-b09b-7d0d427bac0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7834d0e-cf55-4b7b-95fe-7e8fc33b8844]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4889d968-ab13-4f6f-9c63-43278b88ab5c tempest-TestServerVolumeAttachmentScenario-1729486927 None] Created volume successfully. Jul 23 03:28:56 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:28:56 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:56 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD Jul 23 03:28:56 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:56 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.533s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6980c7-a5ac-458f-be30-c8aabc707af3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:56 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] 49836932-aa25-44ae-8bbe-94a4e85d32d9 was raw, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:28:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf Jul 23 03:28:57 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:28:57 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 Jul 23 03:28:57 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:57 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf" returned: 0 in 0.531s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49836932-aa25-44ae-8bbe-94a4e85d32d9_c6ow3b4udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:57 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:28:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:57 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1G Jul 23 03:28:57 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:58 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf 1G" returned: 0 in 0.506s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Downloaded image 49836932-aa25-44ae-8bbe-94a4e85d32d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}])) to volume 26343340-a33b-4ca0-8657-5b53cd64eebf successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Temporary image 49836932-aa25-44ae-8bbe-94a4e85d32d9 for user 11df434da68d4c83b528c1052dfd8535 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Marking volume 26343340-a33b-4ca0-8657-5b53cd64eebf as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Copying metadata from image 49836932-aa25-44ae-8bbe-94a4e85d32d9 to 26343340-a33b-4ca0-8657-5b53cd64eebf. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Creating volume glance metadata for volume 26343340-a33b-4ca0-8657-5b53cd64eebf backed by image 49836932-aa25-44ae-8bbe-94a4e85d32d9 with: {'image_id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4a6895bdebaaabee5da919fc4c911e52', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07688fca-94f1-4b51-9164-d49efe38622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26343340-a33b-4ca0-8657-5b53cd64eebf', 'volume_size': 1, 'image_id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49836932-aa25-44ae-8bbe-94a4e85d32d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a6895bdebaaabee5da919fc4c911e52', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1fb9e898bce48e782b34d3599d4f41d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bbb3336d542ade673e4fc81ddaca18d0e4e1d07877bdf028bf596e5b49e5ead73cd90752b23e40a5e5840bbb2c6db6ef3e89dd8eac6853f3f2ec505c960d0eb', 'id': '49836932-aa25-44ae-8bbe-94a4e85d32d9', 'created_at': datetime.datetime(2026, 7, 23, 1, 28, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 28, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49836932-aa25-44ae-8bbe-94a4e85d32d9/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c1ee7-7cf3-4c26-8fbd-6695e7fb5ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Volume volume-26343340-a33b-4ca0-8657-5b53cd64eebf (26343340-a33b-4ca0-8657-5b53cd64eebf): created successfully Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c1ee7-7cf3-4c26-8fbd-6695e7fb5ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Flow 'volume_create_manager' (36b3806b-fc6f-4371-9eda-13547326999e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5ae58aa7-2987-4021-992b-8a9f732916b3 tempest-VolumeImageDependencyTests-735200931 None] Created volume successfully. Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Acquiring lock "cinder-26343340-a33b-4ca0-8657-5b53cd64eebf-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "cinder-26343340-a33b-4ca0-8657-5b53cd64eebf-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Acquiring lock "cinder-quobyte-26343340-a33b-4ca0-8657-5b53cd64eebf" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "cinder-quobyte-26343340-a33b-4ca0-8657-5b53cd64eebf" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e4c696-6439-4aef-a3ee-c981dd9ea734]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:00 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf Jul 23 03:29:00 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:01 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf" returned: 0 in 1.618s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:01 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf Jul 23 03:29:01 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:02 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-26343340-a33b-4ca0-8657-5b53cd64eebf" returned: 0 in 1.086s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "cinder-quobyte-26343340-a33b-4ca0-8657-5b53cd64eebf" released by "delete_volume" :: held 2.871s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:02 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Created reservations ['a0b4727e-65d0-4c6d-8e75-405226084d53', 'f118e71a-997e-47f2-8f88-184bd587dfac', 'cfbcfe7a-e6b1-465e-a3b0-ac64602856ac', '4c699a1f-da77-4f1b-a45a-055fa6710225'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:03 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:03 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:03 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.700s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:03 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Deleted volume successfully. Jul 23 03:29:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6ce8c815-9fe9-4893-a411-9f3136d5d669 tempest-VolumeImageDependencyTests-735200931 None] Lock "cinder-26343340-a33b-4ca0-8657-5b53cd64eebf-delete_volume" released by "delete_volume" :: held 4.556s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:04 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7" returned: 0 in 7.381s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb440464-c847-40e4-b862-1b86160ba34e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:04 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:29:04 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:05 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.671s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:05 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Converted 1024.00 MB image at 138.72 MB/s Jul 23 03:29:05 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 is being set with open permissions: ugo+rw Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:05 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 Jul 23 03:29:05 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:05 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" released by "_copy_volume_from_snapshot" :: held 9.435s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-bcc46406-9da4-4790-ac2e-a8703316edf7" released by "_create_volume_from_snapshot" :: held 9.478s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.515s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.821s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1318148342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67408e2a-a2af-4baf-a950-4f784956b5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a24b117d114c9e80c88295be9e52a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:44Z,use_quota=True,user_id='c36f1b31e6f94154b52b80388b22c064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Creating volume 67408e2a-a2af-4baf-a950-4f784956b5eb {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:05 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:05 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb 1073741824 Jul 23 03:29:05 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffb1a0-82f1-4cb3-95d9-a69fdf9aa80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc46406-9da4-4790-ac2e-a8703316edf7', 'volume_size': 1, 'snapshot_id': 'b1c8b26e-dfb1-4ec8-9110-c335c99c4aea'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259dcb4a-85e6-414c-9e0e-209ad8f2a4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:05 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Volume volume-bcc46406-9da4-4790-ac2e-a8703316edf7 (bcc46406-9da4-4790-ac2e-a8703316edf7): created successfully Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259dcb4a-85e6-414c-9e0e-209ad8f2a4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Flow 'volume_create_manager' (ac47ea8f-9db3-41ea-afc6-602933844e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a01cc3df-e151-4ce9-9722-edb27086ea29 tempest-VolumesSnapshotTestJSON-1084701213 None] Created volume successfully. Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-bcc46406-9da4-4790-ac2e-a8703316edf7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-bcc46406-9da4-4790-ac2e-a8703316edf7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824a66d-8866-4b82-a967-25bbd7bc420b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 Jul 23 03:29:06 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:06 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb 1073741824" returned: 0 in 0.719s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb Jul 23 03:29:06 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:06 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.688s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:28:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-85287571',display_name='tempest-VolumesGetTest-Volume-873730398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422f4598-4816-4b2a-90fc-bac163fa7373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:56Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Creating volume 422f4598-4816-4b2a-90fc-bac163fa7373 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:06 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 1073741824 Jul 23 03:29:06 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6c1c4c-4eac-47b5-950a-4deae1a2cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67408e2a-a2af-4baf-a950-4f784956b5eb', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b7628a-c6ed-45c4-b66f-913c9766e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:06 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:06 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Volume volume-67408e2a-a2af-4baf-a950-4f784956b5eb (67408e2a-a2af-4baf-a950-4f784956b5eb): created successfully Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b7628a-c6ed-45c4-b66f-913c9766e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Flow 'volume_create_manager' (0c43016d-3ef9-4fb0-9f3b-5a9305b960b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7" returned: 0 in 0.542s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5acf5246-0943-470c-98af-94b78198123a tempest-TestServerVolumeAttachmentScenario-1729486927 None] Created volume successfully. Jul 23 03:29:06 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7 Jul 23 03:29:06 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:07 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-bcc46406-9da4-4790-ac2e-a8703316edf7" returned: 0 in 0.308s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-bcc46406-9da4-4790-ac2e-a8703316edf7" released by "delete_volume" :: held 0.909s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['11b67c9e-90fb-4b6c-88be-c7eb467faac1', 'b15a5a65-8fd8-4521-a10b-8a320239f91e', 'de6d1d79-4522-486c-aeda-ce53271f8edf', 'ddd1e22f-717c-446b-9476-0e95f8980a5d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:07 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 1073741824" returned: 0 in 0.576s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:07 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:07 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:07 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 Jul 23 03:29:07 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:07 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:07 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.308s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4937798-e1b3-44cc-b126-308258dc05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422f4598-4816-4b2a-90fc-bac163fa7373', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624af94-748b-4cc7-b0fd-938ef5ecd1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Deleted volume successfully. Jul 23 03:29:07 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Volume volume-422f4598-4816-4b2a-90fc-bac163fa7373 (422f4598-4816-4b2a-90fc-bac163fa7373): created successfully Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624af94-748b-4cc7-b0fd-938ef5ecd1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (460b38e4-7974-453d-9bc2-0ea847d4aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b234f4a2-0e81-46f5-b662-1075d8360a5e tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-bcc46406-9da4-4790-ac2e-a8703316edf7-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-260a7e43-0d24-4771-9d70-3f7ec3c62505 tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Deleting offline snapshot b1c8b26e-dfb1-4ec8-9110-c335c99c4aea of volume 13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] snapshot_file for this snap is: volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66aba3-0a82-46ec-a372-bac9769b147b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-422f4598-4816-4b2a-90fc-bac163fa7373-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-422f4598-4816-4b2a-90fc-bac163fa7373-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-422f4598-4816-4b2a-90fc-bac163fa7373" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-422f4598-4816-4b2a-90fc-bac163fa7373" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:08 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:29:08 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[143de012-29fa-4b14-9de8-2098d7d1761b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 Jul 23 03:29:09 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.516s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f9df4-b89f-48ae-9d17-5adc881f8414]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:29:09 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373" returned: 0 in 0.508s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373 Jul 23 03:29:09 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:29:09 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:09 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-422f4598-4816-4b2a-90fc-bac163fa7373" returned: 0 in 0.318s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-422f4598-4816-4b2a-90fc-bac163fa7373" released by "delete_volume" :: held 0.882s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Created reservations ['77e36b80-0b38-4724-9111-5f1b5deb132c', '5ef3e20f-2f0e-4da4-a489-183d6f55e43b', 'fdd08329-f0a8-45bc-8701-caa0c3f7323f', '83885dfe-135a-4539-becb-81ffcd833b72'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:09 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:09 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-4acc053f-9eab-4c49-b98f-5498b08aecb6-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "cinder-4acc053f-9eab-4c49-b98f-5498b08aecb6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:10 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.490s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee0b901-b4b2-4f88-ba2d-4262de6e5c67]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea Jul 23 03:29:10 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.331s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-49db8cd8-5720-4ea7-a76f-eed89add9db3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-422f4598-4816-4b2a-90fc-bac163fa7373-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 Jul 23 03:29:10 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb.b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" returned: 0 in 0.326s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea" released by "_delete_snapshot" :: held 1.929s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" released by "delete_snapshot" :: held 1.959s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['7e266092-b01c-4a79-9dbf-7f9317b8ee44', 'dbf38f80-cb1b-4a85-98c4-430ab8501c08', '96475289-21a9-4769-9f75-02dc00a1df74', '4ac2581f-9377-42a4-ac63-6f9049df4e9e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6" returned: 0 in 0.455s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:10 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6 Jul 23 03:29:10 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Delete snapshot completed successfully. Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0363f3f-f096-4572-a923-94cfd5a82847 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-b1c8b26e-dfb1-4ec8-9110-c335c99c4aea-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4acc053f-9eab-4c49-b98f-5498b08aecb6" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-4acc053f-9eab-4c49-b98f-5498b08aecb6" released by "delete_volume" :: held 0.771s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:10 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Created reservations ['85fbaa28-3ae6-431b-a164-221ba420c5d0', '44b756bd-448b-4551-a670-082c02287ad3', '507c2a0b-5ba1-42df-ad6e-1ded33fbb978', 'db35ca14-49f2-4392-9a4c-f6bd2b222c8d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:11 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-10561271-57b0-4d1c-b741-482e371f89c8-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:11 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-10561271-57b0-4d1c-b741-482e371f89c8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f350753b-b1d7-4f8a-a91e-7dba71628738 tempest-VolumesGetTest-1301419278 None] Lock "cinder-4acc053f-9eab-4c49-b98f-5498b08aecb6-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-10561271-57b0-4d1c-b741-482e371f89c8" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-10561271-57b0-4d1c-b741-482e371f89c8" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177113c-840e-44cf-b00c-203b521e9119]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:29:11 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.433s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:11 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8 Jul 23 03:29:11 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e71d47-108b-46b7-8fb1-5bbf961c6c2e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:29:12 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-10561271-57b0-4d1c-b741-482e371f89c8" returned: 0 in 0.296s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-10561271-57b0-4d1c-b741-482e371f89c8" released by "delete_volume" :: held 0.801s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Created reservations ['15b1bca1-11b2-4d2e-b464-6d2eacaa125e', 'b3631426-459e-4e9f-98f0-2828cf28c1ce', '32994963-1988-4309-8b37-f28678bbf753', 'a43548d9-69b9-4c62-a338-95dc61c21da6'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:12 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.437s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb Jul 23 03:29:12 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-471d9238-8539-426d-b369-26ffea4f5cf3 tempest-VolumesGetTest-1301419278 None] Lock "cinder-10561271-57b0-4d1c-b741-482e371f89c8-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:12 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb" released by "delete_volume" :: held 0.821s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['8d1914d0-55fd-426a-82e8-2fdd24fdbf81', 'fae9a3ca-81c2-4c97-bc7e-deef6f37eaf9', '813dc182-3476-454c-819d-4004747ce2a6', '01603f20-f694-44bb-8012-ebd316e6d534'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:13 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-2d99bb74-5b58-4aae-b373-51a3044ea9ec-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-2d99bb74-5b58-4aae-b373-51a3044ea9ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:13 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Deleted volume successfully. Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b047c5ce-fa90-4fbf-9897-af13db571328]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a1cad7be-3139-49ea-83fc-9655097318e5 tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-13b6889d-ef4b-4fac-b2ee-353f19f4ddcb-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (008cec13-d991-49b8-9f79-fd5734e0a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58acb54-b67e-425c-88e5-0160e066798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:13 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec Jul 23 03:29:13 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58acb54-b67e-425c-88e5-0160e066798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647720889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29318ebb-0386-4791-8329-0dac4b492d95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:13Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cddda3a-7ae8-4036-baeb-e3810d451f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cddda3a-7ae8-4036-baeb-e3810d451f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457ac04-63fe-45a7-9eac-8c98fc644a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:29:13 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec" returned: 0 in 0.437s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec Jul 23 03:29:13 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457ac04-63fe-45a7-9eac-8c98fc644a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29318ebb-0386-4791-8329-0dac4b492d95', 'volume_name': 'volume-29318ebb-0386-4791-8329-0dac4b492d95', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e06d1a-5727-45d3-ab70-860ba1cdb698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e06d1a-5727-45d3-ab70-860ba1cdb698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be927f32-0a1c-4631-80af-45bfa3d5e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:14 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Volume 29318ebb-0386-4791-8329-0dac4b492d95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29318ebb-0386-4791-8329-0dac4b492d95', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Trying to clone 29318ebb-0386-4791-8329-0dac4b492d95 from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:29:14 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2d99bb74-5b58-4aae-b373-51a3044ea9ec" returned: 0 in 0.281s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-quobyte-2d99bb74-5b58-4aae-b373-51a3044ea9ec" released by "delete_volume" :: held 0.810s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Created reservations ['3c6e0bc0-4b2e-4834-9e4c-dd043ceb6893', 'ea0f361b-c1cd-4b2d-88f0-eb5db10f86cf', '031687e9-0d9e-444c-bd3a-4f8351a010cb', 'ff3f0d46-0919-4b4f-80d1-48479d019c80'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:29:14 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93739a-a259-4900-bcd6-df78401f04bc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:14 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD Jul 23 03:29:14 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.296s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Deleted volume successfully. Jul 23 03:29:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b505d707-b757-457f-9564-f4f0d2b01e2a tempest-VolumesSnapshotTestJSON-1084701213 None] Lock "cinder-2d99bb74-5b58-4aae-b373-51a3044ea9ec-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:15 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 is fetched for user 000200fdc17d4d86a2a528e61eea61c0. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e30f2d-e0a3-4e23-879b-8d2e9beada56]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD Jul 23 03:29:15 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647720889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29318ebb-0386-4791-8329-0dac4b492d95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:13Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Creating volume 29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:15 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1073741824 Jul 23 03:29:15 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1073741824" returned: 0 in 0.565s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 Jul 23 03:29:16 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95" returned: 0 in 0.392s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Attempting download of ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume 29318ebb-0386-4791-8329-0dac4b492d95. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c05afa-eb37-424d-a42b-f96cdb973bc1]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly Jul 23 03:29:16 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly" returned: 0 in 0.411s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:17 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly Jul 23 03:29:17 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly" returned: 1 in 0.400s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_yrayj5ly' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4775b7-86d2-4330-bee5-0c852370b40a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:17 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD Jul 23 03:29:17 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] ab7985a2-acac-4f9a-9e57-b9a25e5021d5 was qcow2, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:29:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:18 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 Jul 23 03:29:18 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:19 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=110,cinder:UPDATE=135,cinder:INSERT=34,cinder:DELETE=12 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:29:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b8a262e-0891-4044-96ed-ccdb8a3752e1 req-c81be31e-b0b2-402c-8d72-0f1611e05dbe tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b8a262e-0891-4044-96ed-ccdb8a3752e1 req-c81be31e-b0b2-402c-8d72-0f1611e05dbe tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b8a262e-0891-4044-96ed-ccdb8a3752e1 req-c81be31e-b0b2-402c-8d72-0f1611e05dbe tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-1b8a262e-0891-4044-96ed-ccdb8a3752e1 req-c81be31e-b0b2-402c-8d72-0f1611e05dbe tempest-TestServerVolumeAttachmentScenario-1729486927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-0e4becfb-7748-45e8-a6a6-a22969fe0020', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30e97694-5d26-4d1e-8bbd-e0b0e13e82e0', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:29:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-1b8a262e-0891-4044-96ed-ccdb8a3752e1 req-c81be31e-b0b2-402c-8d72-0f1611e05dbe tempest-TestServerVolumeAttachmentScenario-1729486927 None] attachment_update completed successfully. Jul 23 03:29:20 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95" returned: 0 in 2.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_4wqr4ik2devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:20 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Converted 112.00 MB image at 45.39 MB/s Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:20 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1G Jul 23 03:29:20 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:20 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 1G" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Downloaded image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume 29318ebb-0386-4791-8329-0dac4b492d95 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 for user 000200fdc17d4d86a2a528e61eea61c0 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Marking volume 29318ebb-0386-4791-8329-0dac4b492d95 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Copying metadata from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 to 29318ebb-0386-4791-8329-0dac4b492d95. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Creating volume glance metadata for volume 29318ebb-0386-4791-8329-0dac4b492d95 backed by image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be927f32-0a1c-4631-80af-45bfa3d5e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29318ebb-0386-4791-8329-0dac4b492d95', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63812dae-cd34-4de6-a336-f966f74ff81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Volume volume-29318ebb-0386-4791-8329-0dac4b492d95 (29318ebb-0386-4791-8329-0dac4b492d95): created successfully Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63812dae-cd34-4de6-a336-f966f74ff81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (008cec13-d991-49b8-9f79-fd5734e0a26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6e204b07-90f1-46d7-9832-00c88b96668b tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=111,cinder:UPDATE=142,cinder:DELETE=11,cinder:INSERT=49 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Flow 'volume_create_manager' (87c0cf79-d619-49d9-a4e4-1342549228fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df76acae-9468-40e4-ba11-7bfa7b1a0871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df76acae-9468-40e4-ba11-7bfa7b1a0871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-554148690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42da9125-6c15-4cc7-abe8-fd02a5b31aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411bbfc35fcf41b9814d302ccabaf670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:23Z,use_quota=True,user_id='8559cf18a444438f8754d2d20345527d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b70235-f21f-4412-96c9-bfcadbd4f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b70235-f21f-4412-96c9-bfcadbd4f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e386522c-11b7-43f8-8470-0a9475b8c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e386522c-11b7-43f8-8470-0a9475b8c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42da9125-6c15-4cc7-abe8-fd02a5b31aa1', 'volume_name': 'volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1', 'volume_size': 2}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d70c2c4-b153-4851-8a18-c4f551cd02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d70c2c4-b153-4851-8a18-c4f551cd02e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7841be9c-3c79-447d-b3ee-e37b77e6e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Volume 42da9125-6c15-4cc7-abe8-fd02a5b31aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1', 'volume_size': 2} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-554148690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42da9125-6c15-4cc7-abe8-fd02a5b31aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411bbfc35fcf41b9814d302ccabaf670',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:23Z,use_quota=True,user_id='8559cf18a444438f8754d2d20345527d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Creating volume 42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:23 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 2147483648 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 2147483648 Jul 23 03:29:23 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (d09045e1-6a79-4255-bce6-ee3b25fe218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067ef6d-202e-47ec-9fe2-900c6889f922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067ef6d-202e-47ec-9fe2-900c6889f922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295200753',display_name='tempest-VolumesGetTest-Volume-1223080673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3aaa19-25d8-4641-89c7-745989852cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:23Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993783af-13e8-4524-9b5b-f5eafab9db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993783af-13e8-4524-9b5b-f5eafab9db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8b98d0-1204-4566-ac56-55bf3973fa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8b98d0-1204-4566-ac56-55bf3973fa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3aaa19-25d8-4641-89c7-745989852cae', 'volume_name': 'volume-6f3aaa19-25d8-4641-89c7-745989852cae', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bc10dd-bbf5-4e70-81d0-aa8a015ac926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bc10dd-bbf5-4e70-81d0-aa8a015ac926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdd0b30-4bed-4395-8b5d-452e75f19605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Volume 6f3aaa19-25d8-4641-89c7-745989852cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3aaa19-25d8-4641-89c7-745989852cae', 'volume_size': 1} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:23 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 2147483648" returned: 0 in 0.537s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 Jul 23 03:29:23 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" returned: 0 in 0.273s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1295200753',display_name='tempest-VolumesGetTest-Volume-1223080673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3aaa19-25d8-4641-89c7-745989852cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b0baee82b47a89b86412d5fced54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:23Z,use_quota=True,user_id='000200fdc17d4d86a2a528e61eea61c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Creating volume 6f3aaa19-25d8-4641-89c7-745989852cae {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7841be9c-3c79-447d-b3ee-e37b77e6e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1', 'volume_size': 2}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae 1073741824 Jul 23 03:29:24 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c63a267-7e47-49df-b2cf-e407c26b8bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Volume volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 (42da9125-6c15-4cc7-abe8-fd02a5b31aa1): created successfully Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c63a267-7e47-49df-b2cf-e407c26b8bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Flow 'volume_create_manager' (87c0cf79-d619-49d9-a4e4-1342549228fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e821a3cc-e596-414f-8328-11c5b0c9b092 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Created volume successfully. Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ea448eb6-455c-4302-b5ad-40753442edb4 req-e004ca6e-172b-4de0-b75c-6289a6578d61 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:24 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae 1073741824" returned: 0 in 0.434s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:24 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae Jul 23 03:29:24 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:24 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae" returned: 0 in 0.231s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ea448eb6-455c-4302-b5ad-40753442edb4 req-e004ca6e-172b-4de0-b75c-6289a6578d61 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.464s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdd0b30-4bed-4395-8b5d-452e75f19605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3aaa19-25d8-4641-89c7-745989852cae', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214b6ef-7735-4b80-ab53-b795694a37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ea448eb6-455c-4302-b5ad-40753442edb4 req-e004ca6e-172b-4de0-b75c-6289a6578d61 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Volume volume-6f3aaa19-25d8-4641-89c7-745989852cae (6f3aaa19-25d8-4641-89c7-745989852cae): created successfully Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214b6ef-7735-4b80-ab53-b795694a37d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Flow 'volume_create_manager' (d09045e1-6a79-4255-bce6-ee3b25fe218a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6a98e2be-0d2a-4605-a1dc-1ad228f02947 tempest-VolumesGetTest-1301419278 None] Created volume successfully. Jul 23 03:29:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-ea448eb6-455c-4302-b5ad-40753442edb4 req-e004ca6e-172b-4de0-b75c-6289a6578d61 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-67408e2a-a2af-4baf-a950-4f784956b5eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7054d409-df11-4f3b-97ff-03788cad1bdd', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:29:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-ea448eb6-455c-4302-b5ad-40753442edb4 req-e004ca6e-172b-4de0-b75c-6289a6578d61 tempest-TestServerVolumeAttachmentScenario-1729486927 None] attachment_update completed successfully. Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Creating offline snapshot 03e21815-32d3-418e-9e72-9e894a722288 of volume 42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2184d48-0fbc-4adf-8000-cac56c756efa]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 Jul 23 03:29:25 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-6f3aaa19-25d8-4641-89c7-745989852cae-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "cinder-6f3aaa19-25d8-4641-89c7-745989852cae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-6f3aaa19-25d8-4641-89c7-745989852cae" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-6f3aaa19-25d8-4641-89c7-745989852cae" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f599058b-4e07-4ca5-8074-7e1ec7181453]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae Jul 23 03:29:25 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:25 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" returned: 0 in 0.423s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 2G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 2G Jul 23 03:29:25 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae" returned: 0 in 0.358s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae Jul 23 03:29:26 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 2G" returned: 0 in 0.475s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f3aaa19-25d8-4641-89c7-745989852cae" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 Jul 23 03:29:26 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-6f3aaa19-25d8-4641-89c7-745989852cae" released by "delete_volume" :: held 0.723s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Created reservations ['ce9dcc07-19f4-4103-972d-0d65be0607f1', '45b4f57e-69a4-4b5c-af8c-2130a417c2b7', 'f8f518e6-c28d-4633-816f-c7f9b9a3fb8f', 'abe645f3-1dfb-42df-979e-2e8679aede3d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:26 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288" returned: 0 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 is being set with open permissions: ugo+rw Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 Jul 23 03:29:26 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:26 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-29318ebb-0386-4791-8329-0dac4b492d95-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-708cc6ff-fac8-4ed0-8ceb-4ca229a2e163 tempest-VolumesGetTest-1301419278 None] Lock "cinder-6f3aaa19-25d8-4641-89c7-745989852cae-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-29318ebb-0386-4791-8329-0dac4b492d95-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "cinder-quobyte-29318ebb-0386-4791-8329-0dac4b492d95" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-29318ebb-0386-4791-8329-0dac4b492d95" acquired by "delete_volume" :: waited 0.013s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[206186cc-93a6-4511-989b-a2ce3b9a8c92]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info Jul 23 03:29:27 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 Jul 23 03:29:27 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-cbd438c6-6851-4ea6-8081-fec4865fd7cf req-5ff4a007-5aac-417e-b964-aa6aecf6c05d tempest-TestServerVolumeAttachmentScenario-1729486927 None] Terminate volume connection completed successfully. Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-cbd438c6-6851-4ea6-8081-fec4865fd7cf req-5ff4a007-5aac-417e-b964-aa6aecf6c05d tempest-TestServerVolumeAttachmentScenario-1729486927 None] Deleting attachment 7054d409-df11-4f3b-97ff-03788cad1bdd. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:27 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info is being set with open permissions: ugo+rw Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info Jul 23 03:29:27 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95" returned: 0 in 0.417s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95 Jul 23 03:29:27 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.info" returned: 0 in 0.263s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d3f75dd0-ec05-459e-8749-93af5e0b379b tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Create snapshot completed successfully Jul 23 03:29:27 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29318ebb-0386-4791-8329-0dac4b492d95" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-quobyte-29318ebb-0386-4791-8329-0dac4b492d95" released by "delete_volume" :: held 0.720s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Created reservations ['dbb67711-28fe-42d3-8358-058c17080fc8', 'f169bad1-8322-49af-93ee-fbb39770a9c1', '143c8776-df0f-4062-a882-46f9fd487fce', 'f29bb11b-5b23-45f4-acb4-64514001935c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:27 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Deleted volume successfully. Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-60d1a4df-461f-4db8-b7e8-a1f8afa62fe9 tempest-VolumesGetTest-1301419278 None] Lock "cinder-29318ebb-0386-4791-8329-0dac4b492d95-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "cinder-03e21815-32d3-418e-9e72-9e894a722288-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-03e21815-32d3-418e-9e72-9e894a722288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "cinder-quobyte-03e21815-32d3-418e-9e72-9e894a722288" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-03e21815-32d3-418e-9e72-9e894a722288" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Deleting offline snapshot 03e21815-32d3-418e-9e72-9e894a722288 of volume 42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] snapshot_file for this snap is: volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924954e-05aa-4df6-9c22-a6795ea496bb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-b44f2ff1-d2d9-4459-ad91-8505a8cdc5c9 req-3958c34c-bd1a-449d-9b5e-dfb05431ad2e tempest-TestServerVolumeAttachmentScenario-1729486927 None] Terminate volume connection completed successfully. Jul 23 03:29:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-b44f2ff1-d2d9-4459-ad91-8505a8cdc5c9 req-3958c34c-bd1a-449d-9b5e-dfb05431ad2e tempest-TestServerVolumeAttachmentScenario-1729486927 None] Deleting attachment 30e97694-5d26-4d1e-8bbd-e0b0e13e82e0. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:28 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 Jul 23 03:29:28 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:29 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288" returned: 0 in 0.530s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[95531ad4-ef91-432c-92c4-3260f4111af3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 Jul 23 03:29:29 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:29 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" returned: 0 in 0.494s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 Jul 23 03:29:29 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288" returned: 0 in 0.528s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288 Jul 23 03:29:30 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1.03e21815-32d3-418e-9e72-9e894a722288" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-03e21815-32d3-418e-9e72-9e894a722288" released by "_delete_snapshot" :: held 2.086s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" released by "delete_snapshot" :: held 2.123s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:30 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Created reservations ['bb53b653-159c-4541-8113-433ca28f654d', '6d06593b-b3af-4506-9dc5-7b94e66b7446', 'b7bc83d0-38fa-4c81-9f1d-9d1974d320ab', '55c4145b-1d04-4702-a749-333d37b98c28'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Delete snapshot completed successfully. Jul 23 03:29:31 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3e99f7c2-6dd0-47f3-a775-31e853bbe7a9 tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-03e21815-32d3-418e-9e72-9e894a722288-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "cinder-42da9125-6c15-4cc7-abe8-fd02a5b31aa1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-42da9125-6c15-4cc7-abe8-fd02a5b31aa1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62768a-1d04-4c92-b404-a984f5b0a83a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:32 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 Jul 23 03:29:32 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:32 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:32 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1 Jul 23 03:29:32 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:32 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" returned: 0 in 0.352s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-quobyte-42da9125-6c15-4cc7-abe8-fd02a5b31aa1" released by "delete_volume" :: held 0.885s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Created reservations ['d46d512b-b668-4545-b4b3-bc280f84abee', '3c7a6fe2-b8a2-4b17-abc1-7f8140745202', '7ae9e523-2c84-48fb-8b0c-65c3861b661c', '29b87446-f5b8-4a54-b2b1-31e70ff655a0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:33 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:33 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.336s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Deleted volume successfully. Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd584d5-225a-4802-b483-ceca9151fbde tempest-VolumesSnapshotNegativeTestJSON-783340482 None] Lock "cinder-42da9125-6c15-4cc7-abe8-fd02a5b31aa1-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "cinder-67408e2a-a2af-4baf-a950-4f784956b5eb-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-67408e2a-a2af-4baf-a950-4f784956b5eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "cinder-quobyte-67408e2a-a2af-4baf-a950-4f784956b5eb" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-quobyte-67408e2a-a2af-4baf-a950-4f784956b5eb" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[234bb49c-68e8-4252-9211-ed93357051a6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb Jul 23 03:29:33 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb Jul 23 03:29:34 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67408e2a-a2af-4baf-a950-4f784956b5eb" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-quobyte-67408e2a-a2af-4baf-a950-4f784956b5eb" released by "delete_volume" :: held 0.745s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Created reservations ['071e7349-b36b-43bd-95b1-b99f2408b9b3', '056505e1-9c9d-4156-9e12-fa9bf69e4aa4', '678073ff-633a-4253-90de-aee387f0f8e0', '74aecdd7-be48-4a62-85e8-cdb1d5133b14'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:34 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "cinder-0e4becfb-7748-45e8-a6a6-a22969fe0020-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-0e4becfb-7748-45e8-a6a6-a22969fe0020-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "cinder-quobyte-0e4becfb-7748-45e8-a6a6-a22969fe0020" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-quobyte-0e4becfb-7748-45e8-a6a6-a22969fe0020" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c279344-fcb6-4457-a356-4e9133a001b2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.400s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Deleted volume successfully. Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a0d91592-b006-4c47-9d33-2b35509c4a14 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-67408e2a-a2af-4baf-a950-4f784956b5eb-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:35 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 Jul 23 03:29:35 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:35 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020" returned: 0 in 0.419s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020 Jul 23 03:29:35 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:35 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0e4becfb-7748-45e8-a6a6-a22969fe0020" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-quobyte-0e4becfb-7748-45e8-a6a6-a22969fe0020" released by "delete_volume" :: held 0.733s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Created reservations ['bd10b722-e7e3-4c86-86d1-721be232fdf9', 'f9591f35-c42f-44f0-8d7f-5a36f0a990f8', '00ef8107-386f-4dff-8b74-463a8181573e', 'fef98715-2660-41a0-9fca-f52c4a6079a3'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:35 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:35 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:36 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.290s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:36 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Deleted volume successfully. Jul 23 03:29:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f2888de0-2220-4b8a-8dd7-3423276ca398 tempest-TestServerVolumeAttachmentScenario-1729486927 None] Lock "cinder-0e4becfb-7748-45e8-a6a6-a22969fe0020-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Flow 'volume_create_manager' (70a5b3c9-6466-4a8e-8ecc-6ca5d0099d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c3c506-d6d7-460b-9fe3-075d18e559ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c3c506-d6d7-460b-9fe3-075d18e559ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c6eba7-1650-4ef1-8c55-08339aaecac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652237a5e77b48459beb94789b17f6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:39Z,use_quota=True,user_id='dbebb873343548449da0eb79a6eb06c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d537e7c-e374-470f-ba55-3e1d6cdaf2d9),volume_type_id=2d537e7c-e374-470f-ba55-3e1d6cdaf2d9)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff3a1f9-db6d-471f-a49c-52c5d834a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff3a1f9-db6d-471f-a49c-52c5d834a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0cb94d-0c5e-476e-bfc8-6f5c8e03c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0cb94d-0c5e-476e-bfc8-6f5c8e03c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5c6eba7-1650-4ef1-8c55-08339aaecac6', 'volume_name': 'volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6', 'volume_size': 1, 'image_id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa47a3bb1c27ac1f3374da9269c65eef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '652237a5e77b48459beb94789b17f6de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '894749339c3245729632fd7950bf71db8d5efbeab10170829d828804d7f32e188b20f53d50db59cdfd3f537124957f034950e6edc57832059f68d05d9825d79a', 'id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2d2e5b-fb38-47c2-a418-74d179ae7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2d2e5b-fb38-47c2-a418-74d179ae7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06edad0d-56e5-4b83-a30b-1632d179b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:39 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Volume e5c6eba7-1650-4ef1-8c55-08339aaecac6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6', 'volume_size': 1, 'image_id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa47a3bb1c27ac1f3374da9269c65eef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '652237a5e77b48459beb94789b17f6de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '894749339c3245729632fd7950bf71db8d5efbeab10170829d828804d7f32e188b20f53d50db59cdfd3f537124957f034950e6edc57832059f68d05d9825d79a', 'id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Trying to clone e5c6eba7-1650-4ef1-8c55-08339aaecac6 from image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:29:39 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad386b2b-17f8-4669-8799-dc5b21b2c48d]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:40 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:40 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:40 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:40 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:40 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:40 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Temporary image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 is fetched for user dbebb873343548449da0eb79a6eb06c2. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b70557d-6d16-496c-8812-912f75531639]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:40 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:40 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:41 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c6eba7-1650-4ef1-8c55-08339aaecac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652237a5e77b48459beb94789b17f6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:39Z,use_quota=True,user_id='dbebb873343548449da0eb79a6eb06c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d537e7c-e374-470f-ba55-3e1d6cdaf2d9),volume_type_id=2d537e7c-e374-470f-ba55-3e1d6cdaf2d9)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Creating volume e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:41 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1073741824 Jul 23 03:29:41 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1073741824" returned: 0 in 0.549s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 Jul 23 03:29:42 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Attempting download of 0eedeaea-5b22-44f2-8576-bc77f97aaf11 ((None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}])) to volume e5c6eba7-1650-4ef1-8c55-08339aaecac6. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db6e422-b124-4d6b-84a2-b55e2f2eacb5]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5 Jul 23 03:29:42 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5" returned: 0 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5 Jul 23 03:29:43 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5" returned: 1 in 0.381s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0eedeaea-5b22-44f2-8576-bc77f97aaf11_7x7x1qu5' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d16b66-3705-4d4f-ae37-91b9accc9ff2]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:43 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD Jul 23 03:29:43 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:44 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] 0eedeaea-5b22-44f2-8576-bc77f97aaf11 was raw, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:44 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 Jul 23 03:29:44 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:44 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6" returned: 0 in 0.672s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0eedeaea-5b22-44f2-8576-bc77f97aaf11_8g5dttfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:44 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:29:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:44 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1G Jul 23 03:29:44 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:45 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 1G" returned: 0 in 0.363s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Downloaded image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 ((None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}])) to volume e5c6eba7-1650-4ef1-8c55-08339aaecac6 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Temporary image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 for user dbebb873343548449da0eb79a6eb06c2 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Marking volume e5c6eba7-1650-4ef1-8c55-08339aaecac6 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Copying metadata from image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 to e5c6eba7-1650-4ef1-8c55-08339aaecac6. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Creating volume glance metadata for volume e5c6eba7-1650-4ef1-8c55-08339aaecac6 backed by image 0eedeaea-5b22-44f2-8576-bc77f97aaf11 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fa47a3bb1c27ac1f3374da9269c65eef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06edad0d-56e5-4b83-a30b-1632d179b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6', 'volume_size': 1, 'image_id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa47a3bb1c27ac1f3374da9269c65eef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '652237a5e77b48459beb94789b17f6de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '894749339c3245729632fd7950bf71db8d5efbeab10170829d828804d7f32e188b20f53d50db59cdfd3f537124957f034950e6edc57832059f68d05d9825d79a', 'id': '0eedeaea-5b22-44f2-8576-bc77f97aaf11', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0eedeaea-5b22-44f2-8576-bc77f97aaf11/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0c9a71-6d0d-4bbe-baa3-d05302aa17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Volume volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 (e5c6eba7-1650-4ef1-8c55-08339aaecac6): created successfully Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0c9a71-6d0d-4bbe-baa3-d05302aa17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Flow 'volume_create_manager' (70a5b3c9-6466-4a8e-8ecc-6ca5d0099d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-979692e8-2b67-49a8-bfa2-8c858cbceb7b tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Created volume successfully. Jul 23 03:29:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Acquiring lock "cinder-e5c6eba7-1650-4ef1-8c55-08339aaecac6-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "cinder-e5c6eba7-1650-4ef1-8c55-08339aaecac6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Acquiring lock "cinder-quobyte-e5c6eba7-1650-4ef1-8c55-08339aaecac6" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "cinder-quobyte-e5c6eba7-1650-4ef1-8c55-08339aaecac6" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1dbae-be34-4a2a-8692-ec90024a9979]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:46 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 Jul 23 03:29:46 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:46 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6" returned: 0 in 0.455s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:46 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6 Jul 23 03:29:46 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:46 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e5c6eba7-1650-4ef1-8c55-08339aaecac6" returned: 0 in 0.312s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "cinder-quobyte-e5c6eba7-1650-4ef1-8c55-08339aaecac6" released by "delete_volume" :: held 0.827s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:46 devstack cinder-volume[88466]: WARNING cinder.quota [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:46 devstack cinder-volume[88466]: WARNING cinder.quota [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:46 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Created reservations ['b59fc1eb-ad94-4354-b14e-10c5373b50ba', 'a431c4eb-c3b2-497d-9102-5024ca0c945c', '2b11e183-1565-4858-a828-9bb59595bba6', 'e6449eea-9e62-40f8-a58c-4c0d5c99b188'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:47 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:47 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:47 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.447s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Deleted volume successfully. Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-42d46069-d51e-4c66-9d28-ecf40a0b571a tempest-VolumeAndVolumeTypeFromImageTest-1635153789 None] Lock "cinder-e5c6eba7-1650-4ef1-8c55-08339aaecac6-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:47 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:29:47 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:48 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:29:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (726d86f2-ecdb-4ef7-ac06-78c5faba38dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e14abd-3bf3-4654-b767-f1521ada3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e14abd-3bf3-4654-b767-f1521ada3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428977545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6f129-fae5-4b41-a6f0-b41c76dbe4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:54Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f43f8e-7890-48c0-8c08-e334cc83942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f43f8e-7890-48c0-8c08-e334cc83942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d293f-2b87-4fa4-be1d-7d3d2b070234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d293f-2b87-4fa4-be1d-7d3d2b070234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c6f129-fae5-4b41-a6f0-b41c76dbe4d0', 'volume_name': 'volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509282b5-90fe-4cfe-88de-2160a7e0d2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509282b5-90fe-4cfe-88de-2160a7e0d2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ff86d0-f7a9-44f7-a634-1503fac3af18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:53 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Volume 44c6f129-fae5-4b41-a6f0-b41c76dbe4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0', 'volume_size': 1} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428977545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6f129-fae5-4b41-a6f0-b41c76dbe4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:54Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Creating volume 44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:53 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:53 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 1073741824 Jul 23 03:29:53 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (568681bd-c7a8-4ded-94c3-2c898e02bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7360a42-9cbd-4899-9a45-8b65adec971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7360a42-9cbd-4899-9a45-8b65adec971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724517536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a377837a-856a-47b5-808e-35f4c621dd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:54Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1e3ac-892c-4f37-978e-62d26a21d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1e3ac-892c-4f37-978e-62d26a21d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a4036b-4671-44f0-870d-ed4d36c31c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a4036b-4671-44f0-870d-ed4d36c31c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a377837a-856a-47b5-808e-35f4c621dd3a', 'volume_name': 'volume-a377837a-856a-47b5-808e-35f4c621dd3a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d613e8-f0fc-40db-aa04-3b87eab24d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d613e8-f0fc-40db-aa04-3b87eab24d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c49a63-aff8-4a4c-9fd8-92333de38be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Volume a377837a-856a-47b5-808e-35f4c621dd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a377837a-856a-47b5-808e-35f4c621dd3a', 'volume_size': 1} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:54 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 1073741824" returned: 0 in 0.746s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:54 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 Jul 23 03:29:54 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (3943caa8-e8ad-4a37-8cab-e34a4572be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066977e5-75d3-473c-bf22-6df01d970c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066977e5-75d3-473c-bf22-6df01d970c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211230943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c67913-232e-4f6b-bd27-3cc743c96a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:55Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071fe215-00f6-4b3f-97de-d7d8e71af535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071fe215-00f6-4b3f-97de-d7d8e71af535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb86f3bd-c247-4fbb-b8a2-ccee81a635b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb86f3bd-c247-4fbb-b8a2-ccee81a635b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c67913-232e-4f6b-bd27-3cc743c96a14', 'volume_name': 'volume-c8c67913-232e-4f6b-bd27-3cc743c96a14', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4339963-293d-40ed-afb0-50fe8780e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4339963-293d-40ed-afb0-50fe8780e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b283223-9d49-4b3e-a361-efeb3ea79ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Volume c8c67913-232e-4f6b-bd27-3cc743c96a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c67913-232e-4f6b-bd27-3cc743c96a14', 'volume_size': 1} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:54 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" returned: 0 in 0.403s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724517536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a377837a-856a-47b5-808e-35f4c621dd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:54Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Creating volume a377837a-856a-47b5-808e-35f4c621dd3a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:54 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ff86d0-f7a9-44f7-a634-1503fac3af18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca549ed2-61f7-4f97-85a5-96a601a08af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a 1073741824 Jul 23 03:29:55 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Volume volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 (44c6f129-fae5-4b41-a6f0-b41c76dbe4d0): created successfully Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca549ed2-61f7-4f97-85a5-96a601a08af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (726d86f2-ecdb-4ef7-ac06-78c5faba38dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-27594986-886b-406b-9f3d-200b65c73d0e tempest-CreateVolumesFromImageTest-272659623 None] Created volume successfully. Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (9a3430a5-8e6f-4544-acc9-7ec7e660682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef52af4-c933-4346-8de7-e3f2ceb5533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef52af4-c933-4346-8de7-e3f2ceb5533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687734531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ecfc7-48d3-4233-a73c-46d1549f6293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:55Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865ebcea-9ebe-4294-95d5-82583e143d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865ebcea-9ebe-4294-95d5-82583e143d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd851a7-a090-4980-b2c5-42cb529d37cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd851a7-a090-4980-b2c5-42cb529d37cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863ecfc7-48d3-4233-a73c-46d1549f6293', 'volume_name': 'volume-863ecfc7-48d3-4233-a73c-46d1549f6293', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236592a-d8ba-4c30-b3de-21871d3d905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236592a-d8ba-4c30-b3de-21871d3d905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44db510a-5714-4e97-8c38-cbd6b843ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Volume 863ecfc7-48d3-4233-a73c-46d1549f6293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863ecfc7-48d3-4233-a73c-46d1549f6293', 'volume_size': 1} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:55 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a 1073741824" returned: 0 in 0.744s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:55 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a Jul 23 03:29:55 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (6b75210d-f4f9-4c2a-b143-f32e8b08d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cceb6b-7006-4086-abbf-4174b192d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cceb6b-7006-4086-abbf-4174b192d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912328998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315943d8-bdf6-4fba-90ff-459f314ee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:56Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efed3fa5-7434-4f2e-a6ae-756acb4f3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efed3fa5-7434-4f2e-a6ae-756acb4f3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738d8f0b-5147-4af9-bd33-6daa5e363c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738d8f0b-5147-4af9-bd33-6daa5e363c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315943d8-bdf6-4fba-90ff-459f314ee8ef', 'volume_name': 'volume-315943d8-bdf6-4fba-90ff-459f314ee8ef', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bf0ed1-6f1a-4a3a-b1cb-cf6c2079ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bf0ed1-6f1a-4a3a-b1cb-cf6c2079ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff4322-bade-42b0-bc3a-805326c52713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Volume 315943d8-bdf6-4fba-90ff-459f314ee8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315943d8-bdf6-4fba-90ff-459f314ee8ef', 'volume_size': 1} Jul 23 03:29:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:56 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a" returned: 0 in 0.305s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211230943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c67913-232e-4f6b-bd27-3cc743c96a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:55Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Creating volume c8c67913-232e-4f6b-bd27-3cc743c96a14 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:56 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c49a63-aff8-4a4c-9fd8-92333de38be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a377837a-856a-47b5-808e-35f4c621dd3a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dbd4fa-e845-47d0-8e0a-68c905b88108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:56 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 1073741824 Jul 23 03:29:56 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Volume volume-a377837a-856a-47b5-808e-35f4c621dd3a (a377837a-856a-47b5-808e-35f4c621dd3a): created successfully Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dbd4fa-e845-47d0-8e0a-68c905b88108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (568681bd-c7a8-4ded-94c3-2c898e02bcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-326893c0-41f8-4cf1-b0f3-9ab805b23a0b tempest-CreateVolumesFromImageTest-272659623 None] Created volume successfully. Jul 23 03:29:56 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 1073741824" returned: 0 in 0.614s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:56 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 Jul 23 03:29:56 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687734531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ecfc7-48d3-4233-a73c-46d1549f6293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:55Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Creating volume 863ecfc7-48d3-4233-a73c-46d1549f6293 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:57 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b283223-9d49-4b3e-a361-efeb3ea79ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c67913-232e-4f6b-bd27-3cc743c96a14', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb5faf-63fd-4116-91af-fe21f1938985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:57 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 1073741824 Jul 23 03:29:57 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:57 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Volume volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 (c8c67913-232e-4f6b-bd27-3cc743c96a14): created successfully Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb5faf-63fd-4116-91af-fe21f1938985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (3943caa8-e8ad-4a37-8cab-e34a4572be76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-49549272-1ac9-45f1-810c-2b520550ca89 tempest-CreateVolumesFromImageTest-272659623 None] Created volume successfully. Jul 23 03:29:57 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 1073741824" returned: 0 in 0.657s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:57 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 Jul 23 03:29:57 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293" returned: 0 in 0.327s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.180s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912328998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315943d8-bdf6-4fba-90ff-459f314ee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1730b553a8d464aa740cc65fb0e9b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:56Z,use_quota=True,user_id='930901312e55489b89ebc6182afcadad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Creating volume 315943d8-bdf6-4fba-90ff-459f314ee8ef {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:58 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44db510a-5714-4e97-8c38-cbd6b843ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863ecfc7-48d3-4233-a73c-46d1549f6293', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:58 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef 1073741824 Jul 23 03:29:58 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c48e35-7c4c-40cf-a3ad-8e195b04b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Volume volume-863ecfc7-48d3-4233-a73c-46d1549f6293 (863ecfc7-48d3-4233-a73c-46d1549f6293): created successfully Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c48e35-7c4c-40cf-a3ad-8e195b04b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (9a3430a5-8e6f-4544-acc9-7ec7e660682f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f5f37b46-68b2-4c54-b554-7f931709611a tempest-CreateVolumesFromImageTest-272659623 None] Created volume successfully. Jul 23 03:29:58 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef 1073741824" returned: 0 in 0.562s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:58 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef Jul 23 03:29:58 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:59 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef" returned: 0 in 0.313s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff4322-bade-42b0-bc3a-805326c52713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315943d8-bdf6-4fba-90ff-459f314ee8ef', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11d487d-8baf-450e-ba64-c5fad1f94b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Volume volume-315943d8-bdf6-4fba-90ff-459f314ee8ef (315943d8-bdf6-4fba-90ff-459f314ee8ef): created successfully Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11d487d-8baf-450e-ba64-c5fad1f94b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Flow 'volume_create_manager' (6b75210d-f4f9-4c2a-b143-f32e8b08d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f82aae7b-7b1f-4d74-9b2b-cd5453737749 tempest-CreateVolumesFromImageTest-272659623 None] Created volume successfully. Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-315943d8-bdf6-4fba-90ff-459f314ee8ef-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-315943d8-bdf6-4fba-90ff-459f314ee8ef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-quobyte-315943d8-bdf6-4fba-90ff-459f314ee8ef" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-315943d8-bdf6-4fba-90ff-459f314ee8ef" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c76248-12e4-4357-bf93-cb2c45d5f5b3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:00 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef Jul 23 03:30:00 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:00 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef" returned: 0 in 0.467s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:00 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef Jul 23 03:30:00 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:01 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-315943d8-bdf6-4fba-90ff-459f314ee8ef" returned: 0 in 0.306s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-315943d8-bdf6-4fba-90ff-459f314ee8ef" released by "delete_volume" :: held 0.822s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Created reservations ['7919ef85-4cd8-4d70-bbf8-8fae5f6a4cbc', '8bf5f7d5-87e5-4313-9b95-03766713143b', 'f7f3808e-02b9-4106-bae5-7d94db04b0e1', '9d472916-a532-4884-ae9f-f0859a596dc7'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:01 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:01 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-863ecfc7-48d3-4233-a73c-46d1549f6293-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-863ecfc7-48d3-4233-a73c-46d1549f6293-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-quobyte-863ecfc7-48d3-4233-a73c-46d1549f6293" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-863ecfc7-48d3-4233-a73c-46d1549f6293" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b16c61-0b79-43cc-b967-2e930feb5eab]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:01 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.383s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:01 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 Jul 23 03:30:01 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Deleted volume successfully. Jul 23 03:30:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6fd63dcd-1477-4771-8cb7-5f384b27f8f4 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-315943d8-bdf6-4fba-90ff-459f314ee8ef-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:02 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293" returned: 0 in 0.494s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:02 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293 Jul 23 03:30:02 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:02 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-863ecfc7-48d3-4233-a73c-46d1549f6293" returned: 0 in 0.339s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-863ecfc7-48d3-4233-a73c-46d1549f6293" released by "delete_volume" :: held 0.896s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Created reservations ['d25cc814-caf9-4191-b54f-575fba0fb351', '12da0bcb-ebfe-422f-a744-0bee5bb6b26b', '9ce5a762-6c00-4d3f-a606-5b15da418b27', '2914d903-7142-4674-ba51-4822574dfe36'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:02 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:02 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:02 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Deleted volume successfully. Jul 23 03:30:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ece12e4e-0d16-42be-9334-5264420a9ec5 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-863ecfc7-48d3-4233-a73c-46d1549f6293-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-c8c67913-232e-4f6b-bd27-3cc743c96a14-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-c8c67913-232e-4f6b-bd27-3cc743c96a14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-quobyte-c8c67913-232e-4f6b-bd27-3cc743c96a14" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-c8c67913-232e-4f6b-bd27-3cc743c96a14" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cdf0e2-9baf-46cf-88cb-3ce71d9c3a5f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:03 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 Jul 23 03:30:03 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:04 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14" returned: 0 in 0.403s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:04 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14 Jul 23 03:30:04 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:04 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c8c67913-232e-4f6b-bd27-3cc743c96a14" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-c8c67913-232e-4f6b-bd27-3cc743c96a14" released by "delete_volume" :: held 0.757s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Created reservations ['37ff26cb-998f-419b-8a9d-a039ac8d8065', '7cf3e413-dabd-4afe-bf65-477c38ea74a6', 'bfee26af-9a7f-4459-af6b-efb0abcd4527', 'f8fa6033-f95d-4d84-a681-29333f290a82'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:04 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:04 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-a377837a-856a-47b5-808e-35f4c621dd3a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-a377837a-856a-47b5-808e-35f4c621dd3a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-quobyte-a377837a-856a-47b5-808e-35f4c621dd3a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-a377837a-856a-47b5-808e-35f4c621dd3a" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f4e7a-efa1-4df3-ad66-b0e1d85eae18]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Deleted volume successfully. Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1842bb5d-733e-4182-8571-9330f4aecf14 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-c8c67913-232e-4f6b-bd27-3cc743c96a14-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:05 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a Jul 23 03:30:05 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:05 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a Jul 23 03:30:05 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:05 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a377837a-856a-47b5-808e-35f4c621dd3a" returned: 0 in 0.259s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-a377837a-856a-47b5-808e-35f4c621dd3a" released by "delete_volume" :: held 0.730s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Created reservations ['d6019a21-1db4-4867-bcad-63df51a282d5', '842d7fc1-25d3-4090-a3e8-bfe371af55ed', '3a4f2b50-1f52-4545-8da6-02cb996af3ad', '09ffeffd-5574-4e5e-8bfe-0342e9ced829'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:05 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:05 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:06 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.312s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Deleted volume successfully. Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "cinder-quobyte-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-91c651b4-f76d-4dae-968d-561dd3df6fc1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-a377837a-856a-47b5-808e-35f4c621dd3a-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34dc973-b44d-415f-9054-8ab7f92ca0cc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 Jul 23 03:30:06 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0 Jul 23 03:30:06 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:06 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-quobyte-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0" released by "delete_volume" :: held 0.746s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Created reservations ['f3cfaa63-7818-413f-946b-82c9aba02e40', '80e1bc90-dd6b-43e7-ba57-45c090f39d7e', 'a497f1b9-5674-4700-8444-ed4587b9bfd5', '4115d008-6c22-41fb-bae2-22e888894d65'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:07 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:07 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:07 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Deleted volume successfully. Jul 23 03:30:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-944c3a43-e8dc-40c0-88bd-6686188735b1 tempest-CreateVolumesFromImageTest-272659623 None] Lock "cinder-44c6f129-fae5-4b41-a6f0-b41c76dbe4d0-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (54bb8838-7a13-474c-9e72-f71a79aa791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dfcf0b-68ea-426b-9c9f-61b843df189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dfcf0b-68ea-426b-9c9f-61b843df189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-560067725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc76e7d-1f92-4ea6-97e7-383bd8f69716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:08Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(228574e2-df1c-4ff2-aa6c-52a818465bb1),volume_type_id=228574e2-df1c-4ff2-aa6c-52a818465bb1)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf7f8ca-08a0-493f-a5f8-da05773dce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf7f8ca-08a0-493f-a5f8-da05773dce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc273b2e-c444-4bd0-89f4-16f246019e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc273b2e-c444-4bd0-89f4-16f246019e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc76e7d-1f92-4ea6-97e7-383bd8f69716', 'volume_name': 'volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7749841-4f2a-43f8-9858-23790921a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7749841-4f2a-43f8-9858-23790921a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0099e21a-f7b9-4a97-bbd7-6acb850b9d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume 8cc76e7d-1f92-4ea6-97e7-383bd8f69716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716', 'volume_size': 1} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-560067725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc76e7d-1f92-4ea6-97e7-383bd8f69716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:08Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(228574e2-df1c-4ff2-aa6c-52a818465bb1),volume_type_id=228574e2-df1c-4ff2-aa6c-52a818465bb1)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Creating volume 8cc76e7d-1f92-4ea6-97e7-383bd8f69716 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:08 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:08 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 1073741824 Jul 23 03:30:08 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (4ba171c2-86e2-4053-ae17-b096a30d2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc0fc98-1786-4ebb-b450-e36ea99c3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc0fc98-1786-4ebb-b450-e36ea99c3342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1017112219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b90891c2-0640-480f-9d8d-7a634d4f9c11),volume_type_id=b90891c2-0640-480f-9d8d-7a634d4f9c11)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97052d01-de05-4bea-a2a0-87ba91e4d3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97052d01-de05-4bea-a2a0-87ba91e4d3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dce3e5-6222-4287-9072-6517cd064f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dce3e5-6222-4287-9072-6517cd064f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d', 'volume_name': 'volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef50b2-f31c-45ab-be7d-39236f78fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef50b2-f31c-45ab-be7d-39236f78fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360912ab-fd18-4244-9c44-7cbcf8e42ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume 7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d', 'volume_size': 1} Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:08 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 1073741824" returned: 0 in 0.758s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:09 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 Jul 23 03:30:09 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:09 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" returned: 0 in 0.336s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1017112219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b90891c2-0640-480f-9d8d-7a634d4f9c11),volume_type_id=b90891c2-0640-480f-9d8d-7a634d4f9c11)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Creating volume 7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:09 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0099e21a-f7b9-4a97-bbd7-6acb850b9d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:09 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d 1073741824 Jul 23 03:30:09 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1cacb8-b18c-44b0-806a-510260b25e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 (8cc76e7d-1f92-4ea6-97e7-383bd8f69716): created successfully Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1cacb8-b18c-44b0-806a-510260b25e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (54bb8838-7a13-474c-9e72-f71a79aa791f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:09 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-dafb7dd9-2c09-4d9d-bed3-aaa9e01af817 tempest-TestInstancesWithCinderVolumes-1995502023 None] Created volume successfully. Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (69a2a6fb-e291-42ec-86c1-c27ecb8a71fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cec5b3-5ab5-4a1f-acf1-eed582913153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cec5b3-5ab5-4a1f-acf1-eed582913153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1366544932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bdac79-f4ca-4013-9581-403f2dae9a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76dbf572-d7be-46ab-a1a3-a117a0525de6),volume_type_id=76dbf572-d7be-46ab-a1a3-a117a0525de6)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0010f3-e974-47ba-b58b-975045665349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0010f3-e974-47ba-b58b-975045665349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280ac2b9-c168-4b26-b2a4-86b8ed2c52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:09 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:30:10 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d 1073741824" returned: 0 in 0.715s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:10 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d Jul 23 03:30:10 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280ac2b9-c168-4b26-b2a4-86b8ed2c52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29bdac79-f4ca-4013-9581-403f2dae9a5e', 'volume_name': 'volume-29bdac79-f4ca-4013-9581-403f2dae9a5e', 'volume_size': 1, 'image_id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1205927100', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb49e783bc484aef9de990027c0287dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'created_at': datetime.datetime(2026, 7, 23, 1, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ae2369-d1d4-4ae2-81ec-e89dfa2ecd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ae2369-d1d4-4ae2-81ec-e89dfa2ecd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e5d57a-845f-4c61-865f-0b6760842ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume 29bdac79-f4ca-4013-9581-403f2dae9a5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29bdac79-f4ca-4013-9581-403f2dae9a5e', 'volume_size': 1, 'image_id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1205927100', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb49e783bc484aef9de990027c0287dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'created_at': datetime.datetime(2026, 7, 23, 1, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8/file', 'properties': {}}, 'image_service': } Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Trying to clone 29bdac79-f4ca-4013-9581-403f2dae9a5e from image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:30:10 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" returned: 0 in 0.386s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360912ab-fd18-4244-9c44-7cbcf8e42ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df71733-d428-4f3c-b930-d94cb737475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d (7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d): created successfully Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df71733-d428-4f3c-b930-d94cb737475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (4ba171c2-86e2-4053-ae17-b096a30d2b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b0f3d25c-ac49-4661-8373-53cb2559205a tempest-TestInstancesWithCinderVolumes-1995502023 None] Created volume successfully. Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (5fb24c03-dc58-42aa-b362-11370dcdd40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68a7441-15de-489c-9724-68b06abf24dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68a7441-15de-489c-9724-68b06abf24dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815706194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d128f94c-fca9-4f1b-9b22-007d7d503163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:11Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3204e17-5ef1-4084-82b2-a641720cc6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3204e17-5ef1-4084-82b2-a641720cc6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88db9d5-a63b-4517-9fbe-af2a540e87ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88db9d5-a63b-4517-9fbe-af2a540e87ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd128f94c-fca9-4f1b-9b22-007d7d503163', 'volume_name': 'volume-d128f94c-fca9-4f1b-9b22-007d7d503163', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34107aad-b539-49a5-b548-0470361d4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34107aad-b539-49a5-b548-0470361d4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7b27c9-03c6-467d-9f83-5e29b8e24615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:11 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume d128f94c-fca9-4f1b-9b22-007d7d503163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d128f94c-fca9-4f1b-9b22-007d7d503163', 'volume_size': 1} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815706194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d128f94c-fca9-4f1b-9b22-007d7d503163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:11Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:11 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:11 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 1073741824 Jul 23 03:30:11 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:12 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 1073741824" returned: 0 in 0.479s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:12 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 Jul 23 03:30:12 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:12 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163" returned: 0 in 0.315s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7b27c9-03c6-467d-9f83-5e29b8e24615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d128f94c-fca9-4f1b-9b22-007d7d503163', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4309761b-689f-4f30-a446-0d5357ed9845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-d128f94c-fca9-4f1b-9b22-007d7d503163 (d128f94c-fca9-4f1b-9b22-007d7d503163): created successfully Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4309761b-689f-4f30-a446-0d5357ed9845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (5fb24c03-dc58-42aa-b362-11370dcdd40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7f7a8d91-4208-46d0-a565-d96b405bac7a tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating offline snapshot 3900a7b5-f0ea-4190-bf1c-9da04613580a of volume d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:30:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7898d1c2-e3c2-448f-b2b8-dc364032ca6a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:14 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 Jul 23 03:30:14 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:14 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163" returned: 0 in 0.381s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:14 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a 1G Jul 23 03:30:14 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD, size 20.69 MB, duration 4.26 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:30:14 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Image download 20.69 MB at 4.86 MB/s Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d45ba7-2d77-40c5-8dc3-d2cbf6791e1a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:14 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD Jul 23 03:30:14 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:14 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a 1G" returned: 0 in 0.495s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d128f94c-fca9-4f1b-9b22-007d7d503163 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:14 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d128f94c-fca9-4f1b-9b22-007d7d503163 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a Jul 23 03:30:14 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Temporary image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 is fetched for user c88746c0460d49e1b025888cc80368df. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ae20d-0598-437d-8873-aff6f5c8fe39]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d128f94c-fca9-4f1b-9b22-007d7d503163 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a is being set with open permissions: ugo+rw Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a Jul 23 03:30:15 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD Jul 23 03:30:15 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a" returned: 0 in 0.252s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info Jul 23 03:30:15 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:15 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info" returned: 0 in 0.272s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info is being set with open permissions: ugo+rw Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:15 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info Jul 23 03:30:15 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:15 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.info" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1366544932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bdac79-f4ca-4013-9581-403f2dae9a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb49e783bc484aef9de990027c0287dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:09Z,use_quota=True,user_id='c88746c0460d49e1b025888cc80368df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76dbf572-d7be-46ab-a1a3-a117a0525de6),volume_type_id=76dbf572-d7be-46ab-a1a3-a117a0525de6)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Creating volume 29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:15 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1073741824 Jul 23 03:30:16 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-997dc9e9-6dff-4c0a-92ee-4d744cd52edd tempest-CreateVolumesFromSnapshotTest-806702103 None] Create snapshot completed successfully Jul 23 03:30:16 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1073741824" returned: 0 in 0.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e Jul 23 03:30:16 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:16 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Attempting download of 68cfa063-5254-4f63-a7b7-73cabd22c8b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}])) to volume 29bdac79-f4ca-4013-9581-403f2dae9a5e. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88034ac-5a6f-4076-b3ef-fee9f9dce8c1]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:16 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3 Jul 23 03:30:16 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3" returned: 0 in 0.359s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:17 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3 Jul 23 03:30:17 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Flow 'volume_create_manager' (2df4e1c3-fce9-4cc9-9859-5c3a76017b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1991a0-070d-4567-90d9-7ac6c12c3350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1991a0-070d-4567-90d9-7ac6c12c3350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1385705742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b8a728-356f-4ce8-8e8b-bc527a797d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef04355336a4eb7b8545ed979074bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:17Z,use_quota=True,user_id='9502df36ae614de08aaa0adb005dc9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee90e7d-b06b-4ad2-bbbc-9ccb62a027be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee90e7d-b06b-4ad2-bbbc-9ccb62a027be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12a1859-1366-4303-a965-f6e8fc7978bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:30:17 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3" returned: 1 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68cfa063-5254-4f63-a7b7-73cabd22c8b8_guo6cfd3' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cbbb15-0a95-4d44-a976-77c61bb0df6f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (723bc288-11cd-4982-87f6-3d2f1762ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715b6729-0afd-4126-92c0-3f4c858eb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715b6729-0afd-4126-92c0-3f4c858eb637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-646611793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f46e8b-5159-45cf-b694-4e705190e237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:18Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831acc70-2ef7-4e96-b701-8ad092992e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831acc70-2ef7-4e96-b701-8ad092992e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b108a7b9-744b-45cc-a054-0fe7f005a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD Jul 23 03:30:17 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b108a7b9-744b-45cc-a054-0fe7f005a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f46e8b-5159-45cf-b694-4e705190e237', 'volume_name': 'volume-e4f46e8b-5159-45cf-b694-4e705190e237', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fe6a79-70b3-4973-b0a5-24cc9cba83fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fe6a79-70b3-4973-b0a5-24cc9cba83fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98aa247e-3994-421b-b9a2-ff0b9a66acc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume e4f46e8b-5159-45cf-b694-4e705190e237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f46e8b-5159-45cf-b694-4e705190e237', 'volume_size': 1} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-646611793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f46e8b-5159-45cf-b694-4e705190e237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:18Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume e4f46e8b-5159-45cf-b694-4e705190e237 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:17 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:17 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 1073741824 Jul 23 03:30:17 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12a1859-1366-4303-a965-f6e8fc7978bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'volume_name': 'volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b11b0-bd57-4206-9288-7e8045fd2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b11b0-bd57-4206-9288-7e8045fd2217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18c6505-7899-4a77-8f84-0da26d8cd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Volume e8b8a728-356f-4ce8-8e8b-bc527a797d30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Trying to clone e8b8a728-356f-4ce8-8e8b-bc527a797d30 from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:30:17 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:17 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] 68cfa063-5254-4f63-a7b7-73cabd22c8b8 was qcow2, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e Jul 23 03:30:18 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (3e243e6e-2381-4c07-8623-ef5d50c0a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44618012-543f-4071-b610-1d7519347cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44618012-543f-4071-b610-1d7519347cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022121067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68613b79-ddf3-4062-a466-7cfa3161be74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:18Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20a5ab2-d11a-4c0d-8698-cc46645df8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20a5ab2-d11a-4c0d-8698-cc46645df8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25109d8-f852-485d-9200-3978212c347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25109d8-f852-485d-9200-3978212c347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68613b79-ddf3-4062-a466-7cfa3161be74', 'volume_name': 'volume-68613b79-ddf3-4062-a466-7cfa3161be74', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46aae76-3c54-444f-8ff8-ade7286b3a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46aae76-3c54-444f-8ff8-ade7286b3a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbe531-33c1-4343-ae9b-1f17c8816c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume 68613b79-ddf3-4062-a466-7cfa3161be74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68613b79-ddf3-4062-a466-7cfa3161be74', 'volume_size': 1} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:30:18 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 1073741824" returned: 0 in 0.776s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ccf47f-6c45-4ec6-acfb-e103687325b9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 Jul 23 03:30:18 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:18 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD Jul 23 03:30:18 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (32600653-40df-4a38-ae23-5b18c0074ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b2996-2eae-492d-95cd-a8b114eef26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b2996-2eae-492d-95cd-a8b114eef26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-189760402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b8c422-78b6-4512-8535-00910b01af7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e503157f-bc90-40ab-b768-a8f8040b2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e503157f-bc90-40ab-b768-a8f8040b2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2711490-b93e-45a4-9fe8-d74b3c884047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2711490-b93e-45a4-9fe8-d74b3c884047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b8c422-78b6-4512-8535-00910b01af7f', 'volume_name': 'volume-b8b8c422-78b6-4512-8535-00910b01af7f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e76034-65bd-4338-9472-75e602597b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e76034-65bd-4338-9472-75e602597b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775c570f-b106-4514-9967-d42f5d7b672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume b8b8c422-78b6-4512-8535-00910b01af7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b8c422-78b6-4512-8535-00910b01af7f', 'volume_size': 1} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022121067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68613b79-ddf3-4062-a466-7cfa3161be74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:18Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume 68613b79-ddf3-4062-a466-7cfa3161be74 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98aa247e-3994-421b-b9a2-ff0b9a66acc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f46e8b-5159-45cf-b694-4e705190e237', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e218e-12f7-41d3-ae88-dc13dc980243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:18 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 1073741824 Jul 23 03:30:18 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-e4f46e8b-5159-45cf-b694-4e705190e237 (e4f46e8b-5159-45cf-b694-4e705190e237): created successfully Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62e218e-12f7-41d3-ae88-dc13dc980243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:18 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (723bc288-11cd-4982-87f6-3d2f1762ba38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b84b7acd-0a55-4720-b92b-48bfb2d4f814 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:19 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 is fetched for user 9502df36ae614de08aaa0adb005dc9ea. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (a299b8a3-0a4f-49ba-a655-ab4f5ee9d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55994906-a27f-4213-856c-088697ea966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55994906-a27f-4213-856c-088697ea966c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2015642520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676e8785-ab11-46d2-99cc-0d6912468559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9b7fb-733e-4bab-a3aa-de6cdeef0e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9b7fb-733e-4bab-a3aa-de6cdeef0e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9c2c20-1726-478e-9790-8f5339df1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9c2c20-1726-478e-9790-8f5339df1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676e8785-ab11-46d2-99cc-0d6912468559', 'volume_name': 'volume-676e8785-ab11-46d2-99cc-0d6912468559', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d17e00-5f58-488a-bc3d-d6574f0739a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d17e00-5f58-488a-bc3d-d6574f0739a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaf0a3f-b57d-43dc-bd34-e70e5f393614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume 676e8785-ab11-46d2-99cc-0d6912468559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676e8785-ab11-46d2-99cc-0d6912468559', 'volume_size': 1} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=147,cinder:SELECT=114,cinder:INSERT=46,cinder:DELETE=11 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a27a2cd-035a-4cd2-90de-9d670cd5387a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD Jul 23 03:30:19 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:19 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (048557e5-951e-4667-943f-e00fb476cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac6ee1a-860d-4c73-b6a0-6f7acfcda561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 1073741824" returned: 0 in 0.685s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac6ee1a-860d-4c73-b6a0-6f7acfcda561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223875515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e587b61-d558-4570-a0ab-85eac7c2b018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d3add9-1c3a-4148-ad3f-8118f1fb4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d3add9-1c3a-4148-ad3f-8118f1fb4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c75accd-eb1e-4be5-ba54-11754815be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c75accd-eb1e-4be5-ba54-11754815be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e587b61-d558-4570-a0ab-85eac7c2b018', 'volume_name': 'volume-3e587b61-d558-4570-a0ab-85eac7c2b018', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc296e-cd69-467a-b8aa-486fc5df316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc296e-cd69-467a-b8aa-486fc5df316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9967bfc-8d28-4f43-92c7-c2d768123ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume 3e587b61-d558-4570-a0ab-85eac7c2b018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e587b61-d558-4570-a0ab-85eac7c2b018', 'volume_size': 1} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 Jul 23 03:30:19 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:19 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-189760402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b8c422-78b6-4512-8535-00910b01af7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume b8b8c422-78b6-4512-8535-00910b01af7f {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:19 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbe531-33c1-4343-ae9b-1f17c8816c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68613b79-ddf3-4062-a466-7cfa3161be74', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f 1073741824 Jul 23 03:30:19 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8699b6-fcca-4b24-9e2d-583a04c787b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-68613b79-ddf3-4062-a466-7cfa3161be74 (68613b79-ddf3-4062-a466-7cfa3161be74): created successfully Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8699b6-fcca-4b24-9e2d-583a04c787b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (3e243e6e-2381-4c07-8623-ef5d50c0a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-32c651af-4d0d-4dac-8e4a-ef0cef89624f tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:20 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e" returned: 0 in 2.226s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68cfa063-5254-4f63-a7b7-73cabd22c8b8_55dbntt9devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Converted 112.00 MB image at 50.29 MB/s Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1G Jul 23 03:30:20 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f 1073741824" returned: 0 in 0.453s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f Jul 23 03:30:20 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e 1G" returned: 0 in 0.333s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Downloaded image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}])) to volume 29bdac79-f4ca-4013-9581-403f2dae9a5e successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Temporary image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 for user c88746c0460d49e1b025888cc80368df is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Marking volume 29bdac79-f4ca-4013-9581-403f2dae9a5e as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Copying metadata from image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 to 29bdac79-f4ca-4013-9581-403f2dae9a5e. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Creating volume glance metadata for volume 29bdac79-f4ca-4013-9581-403f2dae9a5e backed by image 68cfa063-5254-4f63-a7b7-73cabd22c8b8 with: {'image_id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'image_name': 'tempest-scenario-img--1205927100', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e5d57a-845f-4c61-865f-0b6760842ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29bdac79-f4ca-4013-9581-403f2dae9a5e', 'volume_size': 1, 'image_id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1205927100', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fb49e783bc484aef9de990027c0287dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68cfa063-5254-4f63-a7b7-73cabd22c8b8', 'created_at': datetime.datetime(2026, 7, 23, 1, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 30, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68cfa063-5254-4f63-a7b7-73cabd22c8b8/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff69383-3f72-4446-8fdb-e79c1de5a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:20 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2015642520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676e8785-ab11-46d2-99cc-0d6912468559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume 676e8785-ab11-46d2-99cc-0d6912468559 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Volume volume-29bdac79-f4ca-4013-9581-403f2dae9a5e (29bdac79-f4ca-4013-9581-403f2dae9a5e): created successfully Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff69383-3f72-4446-8fdb-e79c1de5a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:20 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 1073741824 Jul 23 03:30:20 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Flow 'volume_create_manager' (69a2a6fb-e291-42ec-86c1-c27ecb8a71fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775c570f-b106-4514-9967-d42f5d7b672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b8c422-78b6-4512-8535-00910b01af7f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d010d0-ae5c-4f6e-86a9-759b40dc7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2a39e2d3-338d-45da-a620-834d711e9e96 tempest-TestInstancesWithCinderVolumes-1995502023 None] Created volume successfully. Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-b8b8c422-78b6-4512-8535-00910b01af7f (b8b8c422-78b6-4512-8535-00910b01af7f): created successfully Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d010d0-ae5c-4f6e-86a9-759b40dc7254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (32600653-40df-4a38-ae23-5b18c0074ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-88db598a-eb09-4db2-b1af-ac34a3ddb448 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:21 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 1073741824" returned: 0 in 0.402s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 Jul 23 03:30:21 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:21 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559" returned: 0 in 0.231s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223875515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e587b61-d558-4570-a0ab-85eac7c2b018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494c703f07154ba49e188e90235f70df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:19Z,use_quota=True,user_id='8b296036076e498d97a98778d536a81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Creating volume 3e587b61-d558-4570-a0ab-85eac7c2b018 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:21 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaf0a3f-b57d-43dc-bd34-e70e5f393614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676e8785-ab11-46d2-99cc-0d6912468559', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:21 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 1073741824 Jul 23 03:30:21 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e648d8dc-86ef-48cd-8916-f28058c55b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:21 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-676e8785-ab11-46d2-99cc-0d6912468559 (676e8785-ab11-46d2-99cc-0d6912468559): created successfully Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e648d8dc-86ef-48cd-8916-f28058c55b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (a299b8a3-0a4f-49ba-a655-ab4f5ee9d40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:21 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-010ecede-49e3-438a-8f26-3764608d4102 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:21 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 1073741824" returned: 0 in 0.495s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:21 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 Jul 23 03:30:21 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:22 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.444s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1385705742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b8a728-356f-4ce8-8e8b-bc527a797d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef04355336a4eb7b8545ed979074bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:17Z,use_quota=True,user_id='9502df36ae614de08aaa0adb005dc9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Creating volume e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:22 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9967bfc-8d28-4f43-92c7-c2d768123ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e587b61-d558-4570-a0ab-85eac7c2b018', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:22 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1073741824 Jul 23 03:30:22 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5bce9f-a1bc-4ad9-bed7-30aba0b31a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:22 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Volume volume-3e587b61-d558-4570-a0ab-85eac7c2b018 (3e587b61-d558-4570-a0ab-85eac7c2b018): created successfully Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5bce9f-a1bc-4ad9-bed7-30aba0b31a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Flow 'volume_create_manager' (048557e5-951e-4667-943f-e00fb476cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ced876d1-000b-4d6d-8eb5-b969d9f7a687 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created volume successfully. Jul 23 03:30:22 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1073741824" returned: 0 in 0.554s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:22 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 Jul 23 03:30:22 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-3e587b61-d558-4570-a0ab-85eac7c2b018-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-3e587b61-d558-4570-a0ab-85eac7c2b018-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:23 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30" returned: 0 in 0.333s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-3e587b61-d558-4570-a0ab-85eac7c2b018" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-3e587b61-d558-4570-a0ab-85eac7c2b018" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Attempting download of ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume e8b8a728-356f-4ce8-8e8b-bc527a797d30. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4a47d-74f3-459b-8256-bf84b5826493]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d81b1f-fe77-404b-b323-d176501b7114]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 Jul 23 03:30:23 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap Jul 23 03:30:23 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018" returned: 0 in 0.489s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:23 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018 Jul 23 03:30:23 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap Jul 23 03:30:23 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:23 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3e587b61-d558-4570-a0ab-85eac7c2b018" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-3e587b61-d558-4570-a0ab-85eac7c2b018" released by "delete_volume" :: held 0.903s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=136,cinder:UPDATE=155,cinder:DELETE=18,cinder:INSERT=39 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:24 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap" returned: 1 in 0.478s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_ymxty3ap' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b461d2-17a9-4c4e-aaaf-d48dedc6994f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['05b391c8-2324-481e-b133-094e2474595f', '4fcad469-6644-4008-8e00-36c4f539a014', '8a6287b4-6128-4d9e-8636-ecd858e2fe7e', 'a0f7caf2-f8dc-4239-9957-9f456c714cb5'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ad4a2ebf-80b1-4666-be78-e9d005184d40 req-b8c496dd-9041-4499-80db-bf46ff529ac0 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ad4a2ebf-80b1-4666-be78-e9d005184d40 req-b8c496dd-9041-4499-80db-bf46ff529ac0 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:24 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD Jul 23 03:30:24 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-ad4a2ebf-80b1-4666-be78-e9d005184d40 req-b8c496dd-9041-4499-80db-bf46ff529ac0 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:24 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:24 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-ad4a2ebf-80b1-4666-be78-e9d005184d40 req-b8c496dd-9041-4499-80db-bf46ff529ac0 tempest-TestInstancesWithCinderVolumes-1995502023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-29bdac79-f4ca-4013-9581-403f2dae9a5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2699265d-a592-4b13-9ca9-cbbe8d97c988', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:30:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-ad4a2ebf-80b1-4666-be78-e9d005184d40 req-b8c496dd-9041-4499-80db-bf46ff529ac0 tempest-TestInstancesWithCinderVolumes-1995502023 None] attachment_update completed successfully. Jul 23 03:30:24 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:24 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] ab7985a2-acac-4f9a-9e57-b9a25e5021d5 was qcow2, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-367c0917-8fda-434d-8e61-021eb9ec7f94 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-3e587b61-d558-4570-a0ab-85eac7c2b018-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:24 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 Jul 23 03:30:24 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-676e8785-ab11-46d2-99cc-0d6912468559-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-676e8785-ab11-46d2-99cc-0d6912468559-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-676e8785-ab11-46d2-99cc-0d6912468559" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-676e8785-ab11-46d2-99cc-0d6912468559" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae425b30-d805-48df-91fe-a7b83f3b07f9]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:25 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 Jul 23 03:30:25 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:25 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559" returned: 0 in 0.461s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:25 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559 Jul 23 03:30:25 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-676e8785-ab11-46d2-99cc-0d6912468559" returned: 0 in 0.325s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-676e8785-ab11-46d2-99cc-0d6912468559" released by "delete_volume" :: held 0.833s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['d43a3e48-a614-4494-86a4-0612807bf3b4', '6c74257e-217e-4988-8896-675aea554aac', '09898df4-8d08-4632-9515-6bb3dd4bca72', '6b4afa52-0387-4761-898e-a780b5332075'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:26 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:26 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-b8b8c422-78b6-4512-8535-00910b01af7f-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-b8b8c422-78b6-4512-8535-00910b01af7f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-b8b8c422-78b6-4512-8535-00910b01af7f" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-b8b8c422-78b6-4512-8535-00910b01af7f" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95e3391-d930-46f9-b2d5-7ab9ee9081df]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:26 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.318s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:26 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30" returned: 0 in 2.150s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab7985a2-acac-4f9a-9e57-b9a25e5021d5_65qb9sbedevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:26 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Converted 112.00 MB image at 52.06 MB/s Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:26 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f Jul 23 03:30:26 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-05f01290-b9b9-459b-b29c-6b5f36e771f5 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-676e8785-ab11-46d2-99cc-0d6912468559-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:26 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1G Jul 23 03:30:26 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:27 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:27 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f Jul 23 03:30:27 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:27 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 1G" returned: 0 in 0.364s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Downloaded image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}])) to volume e8b8a728-356f-4ce8-8e8b-bc527a797d30 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Temporary image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 for user 9502df36ae614de08aaa0adb005dc9ea is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Marking volume e8b8a728-356f-4ce8-8e8b-bc527a797d30 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Copying metadata from image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 to e8b8a728-356f-4ce8-8e8b-bc527a797d30. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Creating volume glance metadata for volume e8b8a728-356f-4ce8-8e8b-bc527a797d30 backed by image ab7985a2-acac-4f9a-9e57-b9a25e5021d5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18c6505-7899-4a77-8f84-0da26d8cd15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'volume_size': 1, 'image_id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9ba7809f85cf451291df96f2de431783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ab7985a2-acac-4f9a-9e57-b9a25e5021d5', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab7985a2-acac-4f9a-9e57-b9a25e5021d5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e3a2f9-013b-43c3-8133-2f214c3b711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:27 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Volume volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 (e8b8a728-356f-4ce8-8e8b-bc527a797d30): created successfully Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e3a2f9-013b-43c3-8133-2f214c3b711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Flow 'volume_create_manager' (2df4e1c3-fce9-4cc9-9859-5c3a76017b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d0813f3d-19e1-424d-8bb3-d2a773578001 tempest-TestShelveInstance-1346632330 None] Created volume successfully. Jul 23 03:30:27 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8b8c422-78b6-4512-8535-00910b01af7f" returned: 0 in 0.293s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-b8b8c422-78b6-4512-8535-00910b01af7f" released by "delete_volume" :: held 0.777s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['cc98e461-c900-4349-aa25-601d6bf272c8', 'adc88417-56ac-4acc-b82b-e872ec6a3939', '6e762494-baf6-4e03-a882-ce7c7352bed8', '2dac34ac-4851-4486-8b05-08e4a6e77e1d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:27 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:27 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-68613b79-ddf3-4062-a466-7cfa3161be74-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-68613b79-ddf3-4062-a466-7cfa3161be74-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-68613b79-ddf3-4062-a466-7cfa3161be74" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-68613b79-ddf3-4062-a466-7cfa3161be74" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb7e50-1f76-42e2-97bb-f28266542493]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:28 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.450s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:28 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-06ab79f5-ef48-4d1a-98b3-68f5416738cb tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-b8b8c422-78b6-4512-8535-00910b01af7f-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:28 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 Jul 23 03:30:28 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:28 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74" returned: 0 in 0.559s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:28 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74 Jul 23 03:30:28 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:28 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-68613b79-ddf3-4062-a466-7cfa3161be74" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-68613b79-ddf3-4062-a466-7cfa3161be74" released by "delete_volume" :: held 0.922s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['4e15645b-484e-4731-aed3-58a113310ded', '63286c7d-c4d8-4b01-a413-d6fe889144cc', 'b2c187f1-b6bc-49f1-9220-fa3d6cf27888', '3d03c081-b8a3-440d-a87b-2c80f0792e60'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:28 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:28 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-e4f46e8b-5159-45cf-b694-4e705190e237-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-e4f46e8b-5159-45cf-b694-4e705190e237-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-e4f46e8b-5159-45cf-b694-4e705190e237" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-e4f46e8b-5159-45cf-b694-4e705190e237" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[88654d53-6c80-4ff9-9833-2bfdac852fdc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:29 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 Jul 23 03:30:29 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:29 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.502s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6cf3c074-c855-4291-b513-2f9e004ba46f tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-68613b79-ddf3-4062-a466-7cfa3161be74-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:29 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237" returned: 0 in 0.448s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:29 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237 Jul 23 03:30:29 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:29 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e4f46e8b-5159-45cf-b694-4e705190e237" returned: 0 in 0.289s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-e4f46e8b-5159-45cf-b694-4e705190e237" released by "delete_volume" :: held 0.819s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['6c155c33-4f8c-4868-9561-1647eb86260b', '7f7ad6f7-075a-4368-87e9-383b7a88daaf', 'ae2e2427-71d4-4db7-b238-391e2e1181fa', '34f0bca3-84da-47a2-b73a-f671e609cdbf'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:30 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:30 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-3900a7b5-f0ea-4190-bf1c-9da04613580a-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-3900a7b5-f0ea-4190-bf1c-9da04613580a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-3900a7b5-f0ea-4190-bf1c-9da04613580a" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-3900a7b5-f0ea-4190-bf1c-9da04613580a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleting offline snapshot 3900a7b5-f0ea-4190-bf1c-9da04613580a of volume d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] snapshot_file for this snap is: volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ef40c-760d-436c-904d-d82ba87e4bd2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:30 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.391s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:30 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e3c97b2b-81aa-4325-8294-30d1c210c799 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-e4f46e8b-5159-45cf-b694-4e705190e237-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:30 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a Jul 23 03:30:30 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:31 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a" returned: 0 in 0.677s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d128f94c-fca9-4f1b-9b22-007d7d503163(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[512354ef-7075-44a7-9ff1-eb7ae14addcf]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:31 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 Jul 23 03:30:31 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b585232-0adb-444b-96ec-61bd5c3ea342 req-ab34af49-570c-4d8d-9030-7c30990efe87 tempest-TestShelveInstance-1346632330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b585232-0adb-444b-96ec-61bd5c3ea342 req-ab34af49-570c-4d8d-9030-7c30990efe87 tempest-TestShelveInstance-1346632330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:31 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163" returned: 0 in 0.625s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-1b585232-0adb-444b-96ec-61bd5c3ea342 req-ab34af49-570c-4d8d-9030-7c30990efe87 tempest-TestShelveInstance-1346632330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:31 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a Jul 23 03:30:31 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-1b585232-0adb-444b-96ec-61bd5c3ea342 req-ab34af49-570c-4d8d-9030-7c30990efe87 tempest-TestShelveInstance-1346632330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86664529-9af7-4f15-8849-2e7d155245a2', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:30:32 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-1b585232-0adb-444b-96ec-61bd5c3ea342 req-ab34af49-570c-4d8d-9030-7c30990efe87 tempest-TestShelveInstance-1346632330 None] attachment_update completed successfully. Jul 23 03:30:32 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a" returned: 0 in 0.650s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:32 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a Jul 23 03:30:32 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:32 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163.3900a7b5-f0ea-4190-bf1c-9da04613580a" returned: 0 in 0.391s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-3900a7b5-f0ea-4190-bf1c-9da04613580a" released by "_delete_snapshot" :: held 2.534s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" released by "delete_snapshot" :: held 2.578s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['c19e2e7f-3653-4ac0-9210-e1f86841c063', 'cc723fbc-9c4f-4ce3-8cbf-444c8c10ce62', '4bed9935-b5aa-4640-b233-def7f83c44b4', '91c765a3-8d90-4efc-997b-6a78c1f7dbbf'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Delete snapshot completed successfully. Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e37eb67f-35c4-48a8-82f3-986e256bbcf0 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-3900a7b5-f0ea-4190-bf1c-9da04613580a-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-d128f94c-fca9-4f1b-9b22-007d7d503163-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-d128f94c-fca9-4f1b-9b22-007d7d503163-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6537323d-947e-49e1-8964-d19b3aab8402]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 Jul 23 03:30:33 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163" returned: 0 in 0.513s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163 Jul 23 03:30:34 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d128f94c-fca9-4f1b-9b22-007d7d503163" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-quobyte-d128f94c-fca9-4f1b-9b22-007d7d503163" released by "delete_volume" :: held 0.950s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Created reservations ['8333da12-9847-4e7d-97f9-4a22aca1d029', '11ef6ad5-b9d0-494d-9305-1e952dffdb02', 'cf332987-4fcf-4269-8f85-356a6633b3d9', 'ab1724b3-13f2-411f-b47d-f43291f8bb10'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:35 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.881s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:35 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Deleted volume successfully. Jul 23 03:30:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-55962b6a-e100-44db-9886-11ec7e0c7574 tempest-CreateVolumesFromSnapshotTest-806702103 None] Lock "cinder-d128f94c-fca9-4f1b-9b22-007d7d503163-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (80b5ff77-be93-46fd-9ad1-26d01fee0db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79541d3f-edbf-4409-a802-752ed20e3f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79541d3f-edbf-4409-a802-752ed20e3f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784300004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d8856d-0c6f-4227-bdfa-14431946ac39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:41Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b5c8e-2f86-4b45-a369-225cfafec6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10b5c8e-2f86-4b45-a369-225cfafec6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c65f60-6a8c-462a-9c7a-a71625e2f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c65f60-6a8c-462a-9c7a-a71625e2f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d8856d-0c6f-4227-bdfa-14431946ac39', 'volume_name': 'volume-62d8856d-0c6f-4227-bdfa-14431946ac39', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac75d6bd-1bf5-44f9-a246-41a4767e60c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac75d6bd-1bf5-44f9-a246-41a4767e60c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72ce791-363e-4bbc-a525-b4578ce50208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume 62d8856d-0c6f-4227-bdfa-14431946ac39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d8856d-0c6f-4227-bdfa-14431946ac39', 'volume_size': 1} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784300004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d8856d-0c6f-4227-bdfa-14431946ac39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:41Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume 62d8856d-0c6f-4227-bdfa-14431946ac39 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:41 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:41 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 1073741824 Jul 23 03:30:41 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:42 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 1073741824" returned: 0 in 1.090s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:42 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 Jul 23 03:30:42 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:43 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39" returned: 0 in 0.678s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72ce791-363e-4bbc-a525-b4578ce50208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d8856d-0c6f-4227-bdfa-14431946ac39', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d87b45-2f7e-46c9-92f1-2690256b395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-62d8856d-0c6f-4227-bdfa-14431946ac39 (62d8856d-0c6f-4227-bdfa-14431946ac39): created successfully Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d87b45-2f7e-46c9-92f1-2690256b395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (80b5ff77-be93-46fd-9ad1-26d01fee0db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ad5c067a-1a5c-4d25-bbdb-ffdeff455977 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (25017098-5895-42f4-93b8-deacbd59a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72e20ea-3c96-4a3f-bf60-78bda625a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72e20ea-3c96-4a3f-bf60-78bda625a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843163720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:45Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c243bf-7ded-4620-9276-10f11015c28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c243bf-7ded-4620-9276-10f11015c28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c4ef9a-7bad-421d-8089-0c05a87da287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c4ef9a-7bad-421d-8089-0c05a87da287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016', 'volume_name': 'volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b1b82d-592f-4846-96bf-06616fa769b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b1b82d-592f-4846-96bf-06616fa769b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b48bb-b011-4b39-8aa3-b6774ea9ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume 84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016', 'volume_size': 1} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843163720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:45Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume 84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:45 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:45 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 1073741824 Jul 23 03:30:45 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (9ebdb9bd-93ea-4467-835b-bcb92d2efb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d8634-77e7-45e5-8c32-4af546c3bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d8634-77e7-45e5-8c32-4af546c3bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-406625999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27f9303-bbea-4db3-8939-453412e150f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:46Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22034481-2c7b-48e3-b35e-c4ab149ca62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22034481-2c7b-48e3-b35e-c4ab149ca62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7f9a07-676f-4d33-b058-9a392e703233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7f9a07-676f-4d33-b058-9a392e703233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27f9303-bbea-4db3-8939-453412e150f7', 'volume_name': 'volume-e27f9303-bbea-4db3-8939-453412e150f7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53a6d73-16c9-4d45-8cac-f6927dfadd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53a6d73-16c9-4d45-8cac-f6927dfadd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee177d2f-6dbd-44d7-8cfb-e21d281b90b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume e27f9303-bbea-4db3-8939-453412e150f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27f9303-bbea-4db3-8939-453412e150f7', 'volume_size': 1} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:46 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 1073741824" returned: 0 in 0.771s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:46 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 Jul 23 03:30:46 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:46 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (ae83a1e5-97be-4f91-8d4f-2a9e68775fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edda5f7-c8c6-4b30-beb7-82b96d50f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edda5f7-c8c6-4b30-beb7-82b96d50f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413823035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05548da3-47f7-45fe-974a-b9d08c7e0e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:47Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9b5819-a2bc-41f1-b09e-d2721273c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9b5819-a2bc-41f1-b09e-d2721273c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b094dfd-7b18-47c5-9ee9-6a21f4cfc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b094dfd-7b18-47c5-9ee9-6a21f4cfc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05548da3-47f7-45fe-974a-b9d08c7e0e0d', 'volume_name': 'volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5affcec9-0fdc-411a-9f74-d0777569ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5affcec9-0fdc-411a-9f74-d0777569ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ea5f65-71f0-44f2-8b4f-2f844335158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume 05548da3-47f7-45fe-974a-b9d08c7e0e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d', 'volume_size': 1} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" returned: 0 in 0.546s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-406625999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27f9303-bbea-4db3-8939-453412e150f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:46Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume e27f9303-bbea-4db3-8939-453412e150f7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:47 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:47 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 1073741824 Jul 23 03:30:47 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b48bb-b011-4b39-8aa3-b6774ea9ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02556341-7219-459d-8c95-5ee0356be0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 (84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016): created successfully Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02556341-7219-459d-8c95-5ee0356be0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (25017098-5895-42f4-93b8-deacbd59a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-dc4d4edb-228c-4cfa-b3f5-1f614605ed66 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (6b709750-2956-4700-9179-1d260ad63f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dc1ea6-c799-4bb5-bed9-97549f839536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dc1ea6-c799-4bb5-bed9-97549f839536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022228235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0e8814-1ced-426f-a8ac-a9774c4c2edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:47Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de63390d-2cab-4012-92ae-36dd5f178d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de63390d-2cab-4012-92ae-36dd5f178d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e7adae-83bb-4ffb-844b-283eb7b33009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e7adae-83bb-4ffb-844b-283eb7b33009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0e8814-1ced-426f-a8ac-a9774c4c2edc', 'volume_name': 'volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2000a1ea-817d-4880-80ea-75ff8c1e17fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2000a1ea-817d-4880-80ea-75ff8c1e17fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388633b9-8172-4821-b26a-0210a2bdf607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume dd0e8814-1ced-426f-a8ac-a9774c4c2edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc', 'volume_size': 1} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:47 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:47 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:47 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 1073741824" returned: 0 in 0.817s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:48 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 Jul 23 03:30:48 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (6459051c-af75-441a-a232-ed0411704ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1567c14b-eb60-4f87-8197-eaef968cfacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1567c14b-eb60-4f87-8197-eaef968cfacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-580375483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67995cb1-f877-468c-9324-6c206cf5d9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:48Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca03e615-8a11-4524-a48f-acf5c0128af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca03e615-8a11-4524-a48f-acf5c0128af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1320a6-364f-462b-a6bd-5c2684db0faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1320a6-364f-462b-a6bd-5c2684db0faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67995cb1-f877-468c-9324-6c206cf5d9ee', 'volume_name': 'volume-67995cb1-f877-468c-9324-6c206cf5d9ee', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efb42b1-dbaf-4395-8e4d-d484c7258b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efb42b1-dbaf-4395-8e4d-d484c7258b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e59e9e-5f46-4c0c-a8d8-f365c6af7876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume 67995cb1-f877-468c-9324-6c206cf5d9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67995cb1-f877-468c-9324-6c206cf5d9ee', 'volume_size': 1} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.538s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:30:48 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7" returned: 0 in 0.307s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413823035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05548da3-47f7-45fe-974a-b9d08c7e0e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:47Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume 05548da3-47f7-45fe-974a-b9d08c7e0e0d {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:48 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee177d2f-6dbd-44d7-8cfb-e21d281b90b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27f9303-bbea-4db3-8939-453412e150f7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a046c43-bc8e-4be1-95d1-46e0e6b3644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:48 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-e27f9303-bbea-4db3-8939-453412e150f7 (e27f9303-bbea-4db3-8939-453412e150f7): created successfully Jul 23 03:30:48 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d 1073741824 Jul 23 03:30:48 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a046c43-bc8e-4be1-95d1-46e0e6b3644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (9ebdb9bd-93ea-4467-835b-bcb92d2efb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ae627841-475d-4d4f-a742-075d6133620b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:49 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d 1073741824" returned: 0 in 0.608s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d Jul 23 03:30:49 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d" returned: 0 in 0.292s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022228235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0e8814-1ced-426f-a8ac-a9774c4c2edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:47Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume dd0e8814-1ced-426f-a8ac-a9774c4c2edc {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:49 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ea5f65-71f0-44f2-8b4f-2f844335158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15309481-6a6d-4f63-8dac-2a172deca288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:49 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc 1073741824 Jul 23 03:30:49 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d (05548da3-47f7-45fe-974a-b9d08c7e0e0d): created successfully Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15309481-6a6d-4f63-8dac-2a172deca288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (ae83a1e5-97be-4f91-8d4f-2a9e68775fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cb2d8992-9ec9-41ca-a52c-e9bc7409fe55 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:49 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc 1073741824" returned: 0 in 0.477s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:49 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc Jul 23 03:30:49 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-580375483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67995cb1-f877-468c-9324-6c206cf5d9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5264c198eead40538499b704d0b41003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:48Z,use_quota=True,user_id='acd93a70f0f34736924d72cb560f7bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Creating volume 67995cb1-f877-468c-9324-6c206cf5d9ee {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:50 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388633b9-8172-4821-b26a-0210a2bdf607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee 1073741824 Jul 23 03:30:50 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c77e735-12e1-4950-88c1-2a9f51fb5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc (dd0e8814-1ced-426f-a8ac-a9774c4c2edc): created successfully Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c77e735-12e1-4950-88c1-2a9f51fb5647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (6b709750-2956-4700-9179-1d260ad63f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8ac26143-c42e-431d-90cc-6f6416b0c44f tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:50 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee 1073741824" returned: 0 in 0.466s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:50 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee Jul 23 03:30:50 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:50 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e59e9e-5f46-4c0c-a8d8-f365c6af7876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67995cb1-f877-468c-9324-6c206cf5d9ee', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45694966-ef38-49c9-83db-6becd841fd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Volume volume-67995cb1-f877-468c-9324-6c206cf5d9ee (67995cb1-f877-468c-9324-6c206cf5d9ee): created successfully Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45694966-ef38-49c9-83db-6becd841fd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Flow 'volume_create_manager' (6459051c-af75-441a-a232-ed0411704ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2bcadaba-6fbc-479f-b369-adae9bfdf4b9 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created volume successfully. Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-67995cb1-f877-468c-9324-6c206cf5d9ee-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-67995cb1-f877-468c-9324-6c206cf5d9ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-67995cb1-f877-468c-9324-6c206cf5d9ee" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-67995cb1-f877-468c-9324-6c206cf5d9ee" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b9f7c8-f15e-483a-89a6-9cb2c753a261]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:51 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee Jul 23 03:30:51 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:51 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee" returned: 0 in 0.370s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee Jul 23 03:30:52 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:52 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-67995cb1-f877-468c-9324-6c206cf5d9ee" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-67995cb1-f877-468c-9324-6c206cf5d9ee" released by "delete_volume" :: held 0.647s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['2198f3a6-cdcc-42f7-8e2a-164eebb9d5c3', 'b523593c-eae9-4c44-bea2-8641618c6fb2', 'bb849101-4031-4ed7-ad87-de2f75ba3530', '69e86dee-e200-4725-b288-7557cff7bbcc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:52 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:52 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.231s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d4df3b9a-7124-4ab3-b9a5-3d7b77a15b53 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-67995cb1-f877-468c-9324-6c206cf5d9ee-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-dd0e8814-1ced-426f-a8ac-a9774c4c2edc-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-dd0e8814-1ced-426f-a8ac-a9774c4c2edc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf45c05b-e3ca-4953-8102-5b5935f7d7a3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:52 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc Jul 23 03:30:52 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:53 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:53 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc Jul 23 03:30:53 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:53 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" returned: 0 in 0.239s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-dd0e8814-1ced-426f-a8ac-a9774c4c2edc" released by "delete_volume" :: held 0.639s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['14483417-5925-4d1f-a7dd-597c180248f5', '791e059d-6ac7-4424-b9db-5ac8d60119fe', '5cc084ee-ded4-4b32-bf82-e890609b2989', 'ed17e718-cfee-44d2-8cf4-1dcc26af8e22'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:53 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9be161ce-852c-4368-80f7-0429f981a54e tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-dd0e8814-1ced-426f-a8ac-a9774c4c2edc-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-05548da3-47f7-45fe-974a-b9d08c7e0e0d-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-05548da3-47f7-45fe-974a-b9d08c7e0e0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-05548da3-47f7-45fe-974a-b9d08c7e0e0d" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-05548da3-47f7-45fe-974a-b9d08c7e0e0d" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[279807de-3b32-47a1-968b-e6b89cc2d22e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d Jul 23 03:30:54 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d" returned: 0 in 0.362s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d Jul 23 03:30:54 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-05548da3-47f7-45fe-974a-b9d08c7e0e0d" returned: 0 in 0.239s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-05548da3-47f7-45fe-974a-b9d08c7e0e0d" released by "delete_volume" :: held 0.642s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['687caf1c-ead3-4507-bc83-38f642c6a1f3', '3ec12df4-767e-43f4-ba76-0c2906b7f3d2', '7347a5c8-7e73-4218-9fa0-a3520542967c', 'e613d0a0-7e78-4c13-8abb-195a06352930'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:54 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:54 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:54 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.239s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-45fefe42-80df-458c-b0c2-80abd7dad852 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-05548da3-47f7-45fe-974a-b9d08c7e0e0d-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-e27f9303-bbea-4db3-8939-453412e150f7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-e27f9303-bbea-4db3-8939-453412e150f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-e27f9303-bbea-4db3-8939-453412e150f7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-e27f9303-bbea-4db3-8939-453412e150f7" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6823636-b859-4e0e-b382-abcc9cc6dadc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:55 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 Jul 23 03:30:55 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:55 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:55 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7 Jul 23 03:30:55 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:55 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e27f9303-bbea-4db3-8939-453412e150f7" returned: 0 in 0.316s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-e27f9303-bbea-4db3-8939-453412e150f7" released by "delete_volume" :: held 0.782s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['bfbf7783-b645-4067-80cd-693fc65623ab', '5c0b2a6e-de7a-490c-a8f3-04971c670eb0', '297044a1-1135-471f-9e32-f7d306102959', '948917bd-647a-490d-9115-62cd7449ad8f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:56 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc44b84-985f-4a0c-80f1-001558e19d9a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.413s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3571ad52-d79a-4f7f-b1a0-0d44abd8c7e3 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-e27f9303-bbea-4db3-8939-453412e150f7-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:56 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 Jul 23 03:30:56 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:56 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" returned: 0 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:56 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016 Jul 23 03:30:56 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:57 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016" released by "delete_volume" :: held 0.794s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['b75cfd6b-f63d-48bd-b873-e3ed6a934872', 'd388472f-5c7d-42f7-9398-e86ee7375b0b', 'a6da6d9d-92c6-4b15-b7e2-8fae17bf11f9', 'cd1f25ce-39c9-45e0-a366-9dfe95ff3b89'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:57 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:57 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-62d8856d-0c6f-4227-bdfa-14431946ac39-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-62d8856d-0c6f-4227-bdfa-14431946ac39-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "cinder-quobyte-62d8856d-0c6f-4227-bdfa-14431946ac39" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-62d8856d-0c6f-4227-bdfa-14431946ac39" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[03073aa1-c561-4639-89a6-7c3c156f0ab5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:57 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.344s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b797c26a-0882-4ca8-9d7e-7eb147217fd8 tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-84f30b26-3a39-4c5d-b9cd-cb5c8ce9e016-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:57 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 Jul 23 03:30:57 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39" returned: 0 in 0.394s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39 Jul 23 03:30:58 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-62d8856d-0c6f-4227-bdfa-14431946ac39" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-quobyte-62d8856d-0c6f-4227-bdfa-14431946ac39" released by "delete_volume" :: held 0.703s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Created reservations ['fb613846-a5b6-4e4f-b9c5-64c27a03f402', 'e20c8ce8-e6b1-4264-a27c-92fa22c57557', '24bb1bd9-764c-4222-967e-f87fb26469ef', '6178ee70-7f51-44a3-9a59-b7be91237af1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:58 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:30:58 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:58 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Deleted volume successfully. Jul 23 03:30:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-20fcbf4b-f3f5-48d2-aba3-f41e9a62a38b tempest-CreateVolumesFromSourceVolumeTest-1452693826 None] Lock "cinder-62d8856d-0c6f-4227-bdfa-14431946ac39-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Flow 'volume_create_manager' (888577be-1a3c-4f71-9914-dba31ddae512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5be7cc-dcde-4513-921f-0afa555c56dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5be7cc-dcde-4513-921f-0afa555c56dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c16056c-55bb-46f8-a2e2-acd92a7607e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8780b7da5d49139d1e6227001f470f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:01Z,use_quota=True,user_id='816f117cc75748cab4cf2b7df8431c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b2cd57-c6ed-469b-be95-3ec727f2b844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b2cd57-c6ed-469b-be95-3ec727f2b844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3274f53-e890-4d5b-9979-b00fd9fa913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3274f53-e890-4d5b-9979-b00fd9fa913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c16056c-55bb-46f8-a2e2-acd92a7607e7', 'volume_name': 'volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8b987e-985e-4844-8702-099e767df255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8b987e-985e-4844-8702-099e767df255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf8eeef-8c2b-4cbf-8f6a-6f74521d12a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Volume 0c16056c-55bb-46f8-a2e2-acd92a7607e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7', 'volume_size': 1} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c16056c-55bb-46f8-a2e2-acd92a7607e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8780b7da5d49139d1e6227001f470f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:01Z,use_quota=True,user_id='816f117cc75748cab4cf2b7df8431c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Creating volume 0c16056c-55bb-46f8-a2e2-acd92a7607e7 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:01 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:01 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 1073741824 Jul 23 03:31:01 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:01 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 1073741824" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:01 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 Jul 23 03:31:01 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:02 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf8eeef-8c2b-4cbf-8f6a-6f74521d12a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb64d43-88d1-41f9-ac32-90444df891ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Volume volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 (0c16056c-55bb-46f8-a2e2-acd92a7607e7): created successfully Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb64d43-88d1-41f9-ac32-90444df891ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Flow 'volume_create_manager' (888577be-1a3c-4f71-9914-dba31ddae512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:02 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-28f814bd-6d52-4f61-80b4-233d1037418d tempest-CinderUnicodeTest-2100137964 None] Created volume successfully. Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Flow 'volume_create_manager' (1c0175c7-ecce-495f-a381-e9843a3c33da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956f67dd-26cd-4997-8fef-57d5b177f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956f67dd-26cd-4997-8fef-57d5b177f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1590031806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d7f117-3263-4952-a668-799f2c572991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8780b7da5d49139d1e6227001f470f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:03Z,use_quota=True,user_id='816f117cc75748cab4cf2b7df8431c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c723be-b720-4e43-8547-e8669b4de5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c723be-b720-4e43-8547-e8669b4de5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4efd8c-5229-4686-ab31-74b630d11194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4efd8c-5229-4686-ab31-74b630d11194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d7f117-3263-4952-a668-799f2c572991', 'volume_name': 'volume-20d7f117-3263-4952-a668-799f2c572991', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cb2e3d-436a-41b5-9297-426e24c225ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cb2e3d-436a-41b5-9297-426e24c225ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b228f406-9a14-4f3c-a287-6a321eee641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Volume 20d7f117-3263-4952-a668-799f2c572991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d7f117-3263-4952-a668-799f2c572991', 'volume_size': 1} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1590031806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d7f117-3263-4952-a668-799f2c572991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8780b7da5d49139d1e6227001f470f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:03Z,use_quota=True,user_id='816f117cc75748cab4cf2b7df8431c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Creating volume 20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:03 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:03 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 1073741824 Jul 23 03:31:03 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:03 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 1073741824" returned: 0 in 0.471s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:03 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 Jul 23 03:31:03 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:03 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991" returned: 0 in 0.343s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b228f406-9a14-4f3c-a287-6a321eee641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d7f117-3263-4952-a668-799f2c572991', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3814c42-f3ce-4876-8034-306f25ef4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Volume volume-20d7f117-3263-4952-a668-799f2c572991 (20d7f117-3263-4952-a668-799f2c572991): created successfully Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3814c42-f3ce-4876-8034-306f25ef4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Flow 'volume_create_manager' (1c0175c7-ecce-495f-a381-e9843a3c33da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e8248e48-21b5-491f-9420-948fa1823a2d tempest-CinderUnicodeTest-2100137964 None] Created volume successfully. Jul 23 03:31:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-bb3be996-cf66-49af-b63b-8511bf5ec3bc req-3e5ab302-4d1b-466f-9753-e7520566329c tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-bb3be996-cf66-49af-b63b-8511bf5ec3bc req-3e5ab302-4d1b-466f-9753-e7520566329c tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-bb3be996-cf66-49af-b63b-8511bf5ec3bc req-3e5ab302-4d1b-466f-9753-e7520566329c tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-bb3be996-cf66-49af-b63b-8511bf5ec3bc req-3e5ab302-4d1b-466f-9753-e7520566329c tempest-TestInstancesWithCinderVolumes-1995502023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e95684b-48da-44e5-afe8-3c0800eeaa9d', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-bb3be996-cf66-49af-b63b-8511bf5ec3bc req-3e5ab302-4d1b-466f-9753-e7520566329c tempest-TestInstancesWithCinderVolumes-1995502023 None] attachment_update completed successfully. Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Creating offline snapshot d9a37d72-f2d7-45a2-a544-79ae9c5840c0 of volume 20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32f79f-2d70-4216-8b8b-8038eacfb68c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:05 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 Jul 23 03:31:05 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:05 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991" returned: 0 in 0.419s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:05 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 1G Jul 23 03:31:05 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:06 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 1G" returned: 0 in 0.502s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d7f117-3263-4952-a668-799f2c572991 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:06 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d7f117-3263-4952-a668-799f2c572991 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 Jul 23 03:31:06 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-58db2d7a-cc36-42e0-ad0f-9733cfcc8cb2 req-9cfdf64e-82da-4820-808d-5827035340cd tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:06 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d7f117-3263-4952-a668-799f2c572991 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0" returned: 0 in 0.324s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:06 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 is being set with open permissions: ugo+rw Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:06 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 Jul 23 03:31:06 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:06 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:06 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info Jul 23 03:31:06 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:07 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:07 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info is being set with open permissions: ugo+rw Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:07 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info Jul 23 03:31:07 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:07 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.info" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-58db2d7a-cc36-42e0-ad0f-9733cfcc8cb2 req-9cfdf64e-82da-4820-808d-5827035340cd tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.953s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-58db2d7a-cc36-42e0-ad0f-9733cfcc8cb2 req-9cfdf64e-82da-4820-808d-5827035340cd tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a2ecbe3b-85a7-4d6d-a0c7-7c4d20b2d6d7 tempest-CinderUnicodeTest-2100137964 None] Create snapshot completed successfully Jul 23 03:31:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-58db2d7a-cc36-42e0-ad0f-9733cfcc8cb2 req-9cfdf64e-82da-4820-808d-5827035340cd tempest-TestInstancesWithCinderVolumes-1995502023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd584716-1dad-48b8-8927-cf89d0bf29ba', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-58db2d7a-cc36-42e0-ad0f-9733cfcc8cb2 req-9cfdf64e-82da-4820-808d-5827035340cd tempest-TestInstancesWithCinderVolumes-1995502023 None] attachment_update completed successfully. Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-d9a37d72-f2d7-45a2-a544-79ae9c5840c0-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-d9a37d72-f2d7-45a2-a544-79ae9c5840c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-quobyte-d9a37d72-f2d7-45a2-a544-79ae9c5840c0" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-d9a37d72-f2d7-45a2-a544-79ae9c5840c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Deleting offline snapshot d9a37d72-f2d7-45a2-a544-79ae9c5840c0 of volume 20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] snapshot_file for this snap is: volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c76637-6625-4ba8-be48-1e6622c5b5ca]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:08 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 Jul 23 03:31:08 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:09 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0" returned: 0 in 0.400s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d7f117-3263-4952-a668-799f2c572991(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c100eb-e72d-4d4a-b47a-69cfcb4aa354]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:09 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 Jul 23 03:31:09 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:09 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:09 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 Jul 23 03:31:09 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:09 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0" returned: 0 in 0.376s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:09 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0 Jul 23 03:31:09 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:10 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991.d9a37d72-f2d7-45a2-a544-79ae9c5840c0" returned: 0 in 0.247s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-d9a37d72-f2d7-45a2-a544-79ae9c5840c0" released by "_delete_snapshot" :: held 1.517s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" released by "delete_snapshot" :: held 1.540s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Created reservations ['c032611a-2553-4dd9-918d-9e5fec9110e5', '33fe2444-ba9a-4a11-89aa-59ddd154b8d2', 'ba2bfbbb-2e70-4511-8de7-bfcda576788b', '7a169788-ca28-46a8-9cc7-ea322e6f8786'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Delete snapshot completed successfully. Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3dc3228b-090e-43b3-b96d-6815d866e5e2 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-d9a37d72-f2d7-45a2-a544-79ae9c5840c0-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-20d7f117-3263-4952-a668-799f2c572991-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-20d7f117-3263-4952-a668-799f2c572991-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3eed4-1811-4235-817b-48252b16afef]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:10 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 Jul 23 03:31:10 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:11 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991" returned: 0 in 0.385s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:11 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991 Jul 23 03:31:11 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:11 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-20d7f117-3263-4952-a668-799f2c572991" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-20d7f117-3263-4952-a668-799f2c572991" released by "delete_volume" :: held 0.717s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Created reservations ['635a839d-7873-4ff0-9bde-156ea4d2f0fd', 'cd8ccfd7-f241-4140-812d-93c45896ac2a', 'd497e0d6-c2d4-4890-afd7-f14f2042cf07', '248b9337-2921-495b-827e-589c22ffbf04'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:11 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:11 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:11 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Deleted volume successfully. Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-0c16056c-55bb-46f8-a2e2-acd92a7607e7-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5fc2ab2-a3a2-40c8-ace9-c8723bd3cb02 tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-20d7f117-3263-4952-a668-799f2c572991-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-0c16056c-55bb-46f8-a2e2-acd92a7607e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "cinder-quobyte-0c16056c-55bb-46f8-a2e2-acd92a7607e7" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-0c16056c-55bb-46f8-a2e2-acd92a7607e7" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd2b08-c0fc-4a82-ba9c-63c21c7f2f97]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:12 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 Jul 23 03:31:12 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:12 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7" returned: 0 in 0.369s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:12 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7 Jul 23 03:31:12 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-15b65248-8e58-4cb6-99d9-628a77c78bcd req-f07e4165-5af5-4e5e-bbdf-389f6d40b5cf tempest-TestInstancesWithCinderVolumes-1995502023 None] Terminate volume connection completed successfully. Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-15b65248-8e58-4cb6-99d9-628a77c78bcd req-f07e4165-5af5-4e5e-bbdf-389f6d40b5cf tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleting attachment 5e95684b-48da-44e5-afe8-3c0800eeaa9d. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:12 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0c16056c-55bb-46f8-a2e2-acd92a7607e7" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-quobyte-0c16056c-55bb-46f8-a2e2-acd92a7607e7" released by "delete_volume" :: held 0.681s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Created reservations ['254fd375-44b1-4890-8b04-afff9c931652', 'c56f8896-5815-4d56-abcf-ae44b8cbb763', '01455019-d493-499b-af94-84c3cfdebb17', '736e22e4-ee7f-4c3e-b1ef-58b1ef8d1534'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:12 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:12 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:13 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.252s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Deleted volume successfully. Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a2c16744-6c5d-4753-94ec-9b7656a5e44b tempest-CinderUnicodeTest-2100137964 None] Lock "cinder-0c16056c-55bb-46f8-a2e2-acd92a7607e7-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-8cc76e7d-1f92-4ea6-97e7-383bd8f69716-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-8cc76e7d-1f92-4ea6-97e7-383bd8f69716-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-quobyte-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[742baa37-b3af-41ed-b9c2-5eb8d1df929f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:13 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 Jul 23 03:31:13 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:13 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:13 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716 Jul 23 03:31:13 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:13 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-8cc76e7d-1f92-4ea6-97e7-383bd8f69716" released by "delete_volume" :: held 0.741s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:14 devstack cinder-volume[88466]: WARNING cinder.quota [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106651193-1619788474 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106651193-1619788474, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:14 devstack cinder-volume[88466]: WARNING cinder.quota [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106651193-1619788474 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106651193-1619788474, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Created reservations ['88db1707-3ba4-489f-aff1-6a13cea833e7', '8d5d34b0-d886-415c-b1c9-c45d7a0ae453', 'd995bfaf-7eef-473e-89e5-4d663a5e9b57', '4669c252-9b02-4cff-baa8-a39c10cec07c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:14 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:14 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:14 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.255s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleted volume successfully. Jul 23 03:31:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-68c4f91a-6048-44a9-b7c4-36e651fa48c3 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-8cc76e7d-1f92-4ea6-97e7-383bd8f69716-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-cf20b008-768f-4924-a3b4-70a7eb6defe8 req-7f3cadbc-21f6-4dd5-b247-7899049b22d7 tempest-TestInstancesWithCinderVolumes-1995502023 None] Terminate volume connection completed successfully. Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-cf20b008-768f-4924-a3b4-70a7eb6defe8 req-7f3cadbc-21f6-4dd5-b247-7899049b22d7 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleting attachment dd584716-1dad-48b8-8927-cf89d0bf29ba. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-quobyte-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ec0b2-91db-420d-a818-96165732863e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:18 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d Jul 23 03:31:18 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:18 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" returned: 0 in 0.430s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:18 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d Jul 23 03:31:18 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:18 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d" released by "delete_volume" :: held 0.762s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:18 devstack cinder-volume[88466]: WARNING cinder.quota [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-975902350-1968760114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-975902350-1968760114, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:18 devstack cinder-volume[88466]: WARNING cinder.quota [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-975902350-1968760114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-975902350-1968760114, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Created reservations ['be92f2da-25a2-4a97-baf0-0e419c63fc6c', '37be1fd8-ea57-47c0-93a6-27e5600eeda0', '77d208c1-6748-426a-a889-90c5673385a7', '6e0314b8-d314-4cb8-9c83-53d29c89f57f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:18 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:18 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:19 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:19 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleted volume successfully. Jul 23 03:31:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-cb7411b3-938c-4ddf-92d3-d62e70ecfd2e tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-7ed27c7c-a0b7-4f2f-89b5-de7d27eb709d-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:21 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=191,cinder:SELECT=166,cinder:INSERT=50,cinder:DELETE=10 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a7454fae-0122-4b76-af2b-c6ce1d168068 req-1fb5a7dc-7aea-410a-8124-405af67d80ce tempest-TestInstancesWithCinderVolumes-1995502023 None] Terminate volume connection completed successfully. Jul 23 03:31:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-a7454fae-0122-4b76-af2b-c6ce1d168068 req-1fb5a7dc-7aea-410a-8124-405af67d80ce tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleting attachment 2699265d-a592-4b13-9ca9-cbbe8d97c988. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-29bdac79-f4ca-4013-9581-403f2dae9a5e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-29bdac79-f4ca-4013-9581-403f2dae9a5e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "cinder-quobyte-29bdac79-f4ca-4013-9581-403f2dae9a5e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-29bdac79-f4ca-4013-9581-403f2dae9a5e" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f856d4-635b-4868-9068-04bd510ea3cf]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:23 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e Jul 23 03:31:23 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:23 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e" returned: 0 in 0.489s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:23 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e Jul 23 03:31:23 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-e7918617-1051-45d1-9a69-74adf8249c17 req-8afec01b-8f86-437b-86d9-cb128609a3e4 tempest-TestShelveInstance-1346632330 None] Terminate volume connection completed successfully. Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-e7918617-1051-45d1-9a69-74adf8249c17 req-8afec01b-8f86-437b-86d9-cb128609a3e4 tempest-TestShelveInstance-1346632330 None] Deleting attachment 86664529-9af7-4f15-8849-2e7d155245a2. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:23 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-29bdac79-f4ca-4013-9581-403f2dae9a5e" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-quobyte-29bdac79-f4ca-4013-9581-403f2dae9a5e" released by "delete_volume" :: held 0.801s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:23 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196271727-1026036097 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196271727-1026036097, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:23 devstack cinder-volume[88466]: WARNING cinder.quota [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196271727-1026036097 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196271727-1026036097, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Created reservations ['e290675f-8489-4815-a881-d49cd0c317d6', '02617c99-5fa4-4734-a4c0-17dd9fc67783', 'f9d2d77a-9a9d-4a3c-822b-abed8ce84609', '67042ecc-0f1b-446c-8b7f-962221369ff3'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:23 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:23 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:24 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.310s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:24 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Deleted volume successfully. Jul 23 03:31:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bdd76756-156a-40e3-9b72-5bfe5b5f1703 tempest-TestInstancesWithCinderVolumes-1995502023 None] Lock "cinder-29bdac79-f4ca-4013-9581-403f2dae9a5e-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:27 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:INSERT=52,cinder:UPDATE=175,cinder:SELECT=144,cinder:DELETE=18 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-2b634e1f-11fb-42da-9056-704cc3baaeb7 req-a9633de2-9ee8-48a7-936f-94a44e375d4c tempest-TestShelveInstance-1346632330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-2b634e1f-11fb-42da-9056-704cc3baaeb7 req-a9633de2-9ee8-48a7-936f-94a44e375d4c tempest-TestShelveInstance-1346632330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-2b634e1f-11fb-42da-9056-704cc3baaeb7 req-a9633de2-9ee8-48a7-936f-94a44e375d4c tempest-TestShelveInstance-1346632330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:27 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-2b634e1f-11fb-42da-9056-704cc3baaeb7 req-a9633de2-9ee8-48a7-936f-94a44e375d4c tempest-TestShelveInstance-1346632330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd56cd62-de0c-4179-a008-d741b426906f', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-2b634e1f-11fb-42da-9056-704cc3baaeb7 req-a9633de2-9ee8-48a7-936f-94a44e375d4c tempest-TestShelveInstance-1346632330 None] attachment_update completed successfully. Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Flow 'volume_create_manager' (faa26157-3b28-4c64-9bbf-3557182d2182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1095945-1220-4356-a920-1abbc197ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1095945-1220-4356-a920-1abbc197ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1775397176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e6b844-bad0-4df8-9510-d0315b911059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fde79141d048faaa74f1029ee448b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:37Z,use_quota=True,user_id='d06280889f394be28fae75f1426dcdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18ff5cc-3441-4afe-81c1-97f850a2161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18ff5cc-3441-4afe-81c1-97f850a2161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f704022-1224-4992-97e8-38175c6a6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f704022-1224-4992-97e8-38175c6a6524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e6b844-bad0-4df8-9510-d0315b911059', 'volume_name': 'volume-18e6b844-bad0-4df8-9510-d0315b911059', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38636bde-540b-49c7-a171-01dda02dcd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38636bde-540b-49c7-a171-01dda02dcd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f77a9b-f182-4571-a703-45912207cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Volume 18e6b844-bad0-4df8-9510-d0315b911059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e6b844-bad0-4df8-9510-d0315b911059', 'volume_size': 1} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1775397176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e6b844-bad0-4df8-9510-d0315b911059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fde79141d048faaa74f1029ee448b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:37Z,use_quota=True,user_id='d06280889f394be28fae75f1426dcdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Creating volume 18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:37 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:37 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 1073741824 Jul 23 03:31:37 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 1073741824" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:37 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:37 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.273s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f77a9b-f182-4571-a703-45912207cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e6b844-bad0-4df8-9510-d0315b911059', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51e66e-6fc8-44ba-a25e-bf6704061629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Volume volume-18e6b844-bad0-4df8-9510-d0315b911059 (18e6b844-bad0-4df8-9510-d0315b911059): created successfully Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51e66e-6fc8-44ba-a25e-bf6704061629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Flow 'volume_create_manager' (faa26157-3b28-4c64-9bbf-3557182d2182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d4247745-5bc0-4757-828e-46b8ba85de49 tempest-VolumeDependencyTests-27520891 None] Created volume successfully. Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Creating offline snapshot 106ab817-f68b-4ab0-97dc-14582439720e of volume 18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1046f7b1-52a6-4532-bba8-bed6f8f06cc0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:38 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:38 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:38 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.351s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:38 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e 1G Jul 23 03:31:38 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:39 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e 1G" returned: 0 in 0.386s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6b844-bad0-4df8-9510-d0315b911059 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6b844-bad0-4df8-9510-d0315b911059 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:39 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:39 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e6b844-bad0-4df8-9510-d0315b911059 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:39 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e is being set with open permissions: ugo+rw Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:39 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:39 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info Jul 23 03:31:39 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:39 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:39 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info is being set with open permissions: ugo+rw Jul 23 03:31:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info Jul 23 03:31:39 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:40 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.info" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:40 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-18f02d11-d108-4ad8-a7f3-d80e55be9cf3 tempest-VolumeDependencyTests-27520891 None] Create snapshot completed successfully Jul 23 03:31:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Flow 'volume_create_manager' (474d58d2-cc95-4570-b167-db802ee38b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b039f1f-2dfb-43de-858b-41e94a765232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b039f1f-2dfb-43de-858b-41e94a765232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1600432609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da380c3c-7797-4291-93f9-53d48eeae6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fde79141d048faaa74f1029ee448b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=106ab817-f68b-4ab0-97dc-14582439720e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:41Z,use_quota=True,user_id='d06280889f394be28fae75f1426dcdf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6163b4-3336-4fcf-a914-01a8e85d32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6163b4-3336-4fcf-a914-01a8e85d32c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c2f368-1a02-468e-9807-1eaeb4a395bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c2f368-1a02-468e-9807-1eaeb4a395bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da380c3c-7797-4291-93f9-53d48eeae6b1', 'volume_name': 'volume-da380c3c-7797-4291-93f9-53d48eeae6b1', 'volume_size': 1, 'snapshot_id': '106ab817-f68b-4ab0-97dc-14582439720e'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061541de-ffdf-4f86-b67b-c0eceaef5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061541de-ffdf-4f86-b67b-c0eceaef5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787711f8-7074-47a9-8f95-b68036eac7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Volume da380c3c-7797-4291-93f9-53d48eeae6b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da380c3c-7797-4291-93f9-53d48eeae6b1', 'volume_size': 1, 'snapshot_id': '106ab817-f68b-4ab0-97dc-14582439720e'} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e-da380c3c-7797-4291-93f9-53d48eeae6b1" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e-da380c3c-7797-4291-93f9-53d48eeae6b1" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Creating volume da380c3c-7797-4291-93f9-53d48eeae6b1 from snapshot 106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] snapshot: 106ab817-f68b-4ab0-97dc-14582439720e, volume: da380c3c-7797-4291-93f9-53d48eeae6b1, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97b3a2-4789-4d9c-9832-8e9d2c364eac]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:41 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:41 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:41 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.354s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e6b844-bad0-4df8-9510-d0315b911059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a011dd-bc1d-4af5-ba37-68887e6d2e8c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:41 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:41 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:41 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:31:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:41 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 Jul 23 03:31:41 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1" returned: 0 in 4.111s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5b9100-9010-41ff-b937-d80ba56d8179]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:46 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.531s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059, size 1024.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:31:46 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Converted 1024.00 MB image at 248.99 MB/s Jul 23 03:31:46 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 is being set with open permissions: ugo+rw Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 Jul 23 03:31:46 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1" returned: 0 in 0.237s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" released by "_copy_volume_from_snapshot" :: held 5.674s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e-da380c3c-7797-4291-93f9-53d48eeae6b1" released by "_create_volume_from_snapshot" :: held 5.704s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.720s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787711f8-7074-47a9-8f95-b68036eac7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da380c3c-7797-4291-93f9-53d48eeae6b1', 'volume_size': 1, 'snapshot_id': '106ab817-f68b-4ab0-97dc-14582439720e'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500eb5e-52d6-409b-ad8d-3848dc0c15c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Volume volume-da380c3c-7797-4291-93f9-53d48eeae6b1 (da380c3c-7797-4291-93f9-53d48eeae6b1): created successfully Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500eb5e-52d6-409b-ad8d-3848dc0c15c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Flow 'volume_create_manager' (474d58d2-cc95-4570-b167-db802ee38b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4c4e236b-14bb-4261-b72d-73d94c1fe82e tempest-VolumeDependencyTests-27520891 None] Created volume successfully. Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-106ab817-f68b-4ab0-97dc-14582439720e-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-106ab817-f68b-4ab0-97dc-14582439720e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Deleting offline snapshot 106ab817-f68b-4ab0-97dc-14582439720e of volume 18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] snapshot_file for this snap is: volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0d4351-e378-4903-94be-b26292896d45]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:47 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:47 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:47 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:47 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:48 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.367s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e6b844-bad0-4df8-9510-d0315b911059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad957bea-381f-43fd-8d20-c80885c4eb9a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:48 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:48 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:48 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:48 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:48 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:48 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e Jul 23 03:31:48 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:49 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059.106ab817-f68b-4ab0-97dc-14582439720e" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-106ab817-f68b-4ab0-97dc-14582439720e" released by "_delete_snapshot" :: held 1.468s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" released by "delete_snapshot" :: held 1.492s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Created reservations ['385fdfb0-a1ad-4463-a755-618edf49548c', '32256278-aaa5-425b-ab9e-0c189d492322', 'a0acdedf-9952-4cf7-bf82-0f78d9f8119a', 'a371e109-7fe6-45e8-a953-01c173fe1fee'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Delete snapshot completed successfully. Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a87529ec-b84d-4bb6-8c6d-0d49a60586b9 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-106ab817-f68b-4ab0-97dc-14582439720e-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-18e6b844-bad0-4df8-9510-d0315b911059-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-18e6b844-bad0-4df8-9510-d0315b911059-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a367ec12-0c15-4470-9e84-ee752c892c91]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:49 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:49 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:50 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.354s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:50 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059 Jul 23 03:31:50 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:50 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18e6b844-bad0-4df8-9510-d0315b911059" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-18e6b844-bad0-4df8-9510-d0315b911059" released by "delete_volume" :: held 0.653s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Created reservations ['ebac6ad4-2dd4-4567-81f9-43a2b1ee1459', '617cea01-1087-45d7-84d8-a1be99dd8915', 'cd642ebb-6f54-4e00-ad53-a2b532d01c7b', '8e028781-74de-4d96-b887-f69571713e73'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:50 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:50 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:50 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Deleted volume successfully. Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-381ff6b8-897b-44c5-8591-0db0c38f9646 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-18e6b844-bad0-4df8-9510-d0315b911059-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-da380c3c-7797-4291-93f9-53d48eeae6b1-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-da380c3c-7797-4291-93f9-53d48eeae6b1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d6fb7-f36f-45f2-b270-f3b07173af09]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 Jul 23 03:31:51 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1" returned: 0 in 0.347s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1 Jul 23 03:31:51 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-da380c3c-7797-4291-93f9-53d48eeae6b1" returned: 0 in 0.229s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-quobyte-da380c3c-7797-4291-93f9-53d48eeae6b1" released by "delete_volume" :: held 0.616s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Created reservations ['27dce72f-fb18-486b-baa2-d9b27c09ce43', 'b114b204-eccd-4ba6-8cc7-d6dc5bf7b46a', '7ca4574c-105e-4921-b300-341f35a9b3e4', 'e135a4d1-2d20-448d-aa44-d0bee67c8c0c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:51 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:52 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Deleted volume successfully. Jul 23 03:31:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-125abfe9-c1d6-47c8-bdd5-c5521efc7a16 tempest-VolumeDependencyTests-27520891 None] Lock "cinder-da380c3c-7797-4291-93f9-53d48eeae6b1-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Flow 'volume_create_manager' (92f7ae2c-2e21-41a3-9fc8-663738640375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91bf24a-9250-43e3-a534-6a7b8208b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91bf24a-9250-43e3-a534-6a7b8208b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563074947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54a853b-28a8-4b04-be08-274786c98a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7936b81e243f796f80515e95eaaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:55Z,use_quota=True,user_id='ce38973d3f8e43a687fce59ab2bda534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3e473b-54e4-411c-bc5b-288e0178119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3e473b-54e4-411c-bc5b-288e0178119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea6321-00de-4334-863a-e7f30c95d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea6321-00de-4334-863a-e7f30c95d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54a853b-28a8-4b04-be08-274786c98a41', 'volume_name': 'volume-a54a853b-28a8-4b04-be08-274786c98a41', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0894c6-6717-40c5-9193-d70558cf8ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0894c6-6717-40c5-9193-d70558cf8ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1974ea57-69a2-4195-90a1-1030a8359196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Volume a54a853b-28a8-4b04-be08-274786c98a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54a853b-28a8-4b04-be08-274786c98a41', 'volume_size': 1} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563074947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54a853b-28a8-4b04-be08-274786c98a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7936b81e243f796f80515e95eaaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:55Z,use_quota=True,user_id='ce38973d3f8e43a687fce59ab2bda534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Creating volume a54a853b-28a8-4b04-be08-274786c98a41 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:55 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:55 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 1073741824 Jul 23 03:31:55 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:55 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 1073741824" returned: 0 in 0.444s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:56 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 Jul 23 03:31:56 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:56 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41" returned: 0 in 0.245s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1974ea57-69a2-4195-90a1-1030a8359196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54a853b-28a8-4b04-be08-274786c98a41', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65480ccb-e830-4bb6-a847-b0cf7c3fd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Volume volume-a54a853b-28a8-4b04-be08-274786c98a41 (a54a853b-28a8-4b04-be08-274786c98a41): created successfully Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65480ccb-e830-4bb6-a847-b0cf7c3fd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Flow 'volume_create_manager' (92f7ae2c-2e21-41a3-9fc8-663738640375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-48f9dc0a-bf06-45ae-a216-70d3882f4e40 tempest-ProjectReaderTests-88753850 None] Created volume successfully. Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Acquiring lock "cinder-a54a853b-28a8-4b04-be08-274786c98a41-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "cinder-a54a853b-28a8-4b04-be08-274786c98a41-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Acquiring lock "cinder-quobyte-a54a853b-28a8-4b04-be08-274786c98a41" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "cinder-quobyte-a54a853b-28a8-4b04-be08-274786c98a41" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb86ce00-e6f8-4bfc-bc87-35477b8a53e1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:56 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 Jul 23 03:31:56 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41" returned: 0 in 0.356s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:57 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41 Jul 23 03:31:57 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a54a853b-28a8-4b04-be08-274786c98a41" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "cinder-quobyte-a54a853b-28a8-4b04-be08-274786c98a41" released by "delete_volume" :: held 0.646s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Created reservations ['3d5d2a00-aac9-4d58-8e21-3a7229515f56', 'b68bf9c8-96c3-48bc-af5d-6a5dcbd77680', '422024ec-6dc6-441a-a44b-470daac1e4d9', '38e52230-503c-41c3-8bd3-73104bd48b55'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:57 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:31:57 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.237s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Deleted volume successfully. Jul 23 03:31:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ab605d47-cae4-41be-a7d5-226f4de03527 tempest-ProjectReaderTests-88753850 None] Lock "cinder-a54a853b-28a8-4b04-be08-274786c98a41-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Flow 'volume_create_manager' (b40437fd-c34f-4ad5-9811-a6195305808e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d93f1-a6ff-454b-8796-6943cea7cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2d93f1-a6ff-454b-8796-6943cea7cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39128846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afed4e2-4b84-4acb-83fd-e084438260fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7936b81e243f796f80515e95eaaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:58Z,use_quota=True,user_id='ce38973d3f8e43a687fce59ab2bda534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6e0d23-0020-46aa-bbde-2e63f6cf0af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6e0d23-0020-46aa-bbde-2e63f6cf0af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dacaf68-2ee3-4f18-925f-2088af1e4dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dacaf68-2ee3-4f18-925f-2088af1e4dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afed4e2-4b84-4acb-83fd-e084438260fc', 'volume_name': 'volume-7afed4e2-4b84-4acb-83fd-e084438260fc', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dcb695-4062-48dc-a4fe-a1ca40a09949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dcb695-4062-48dc-a4fe-a1ca40a09949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb48352-39d3-463b-8a80-0a0d8543087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Volume 7afed4e2-4b84-4acb-83fd-e084438260fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afed4e2-4b84-4acb-83fd-e084438260fc', 'volume_size': 1} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39128846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afed4e2-4b84-4acb-83fd-e084438260fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7936b81e243f796f80515e95eaaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:58Z,use_quota=True,user_id='ce38973d3f8e43a687fce59ab2bda534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Creating volume 7afed4e2-4b84-4acb-83fd-e084438260fc {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:58 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:58 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc 1073741824 Jul 23 03:31:58 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:58 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc 1073741824" returned: 0 in 0.413s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:58 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc Jul 23 03:31:58 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:58 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc" returned: 0 in 0.243s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb48352-39d3-463b-8a80-0a0d8543087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afed4e2-4b84-4acb-83fd-e084438260fc', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe2b040-5112-4131-a817-f45e0b0256fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Volume volume-7afed4e2-4b84-4acb-83fd-e084438260fc (7afed4e2-4b84-4acb-83fd-e084438260fc): created successfully Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe2b040-5112-4131-a817-f45e0b0256fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Flow 'volume_create_manager' (b40437fd-c34f-4ad5-9811-a6195305808e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7f985627-b61b-4849-8941-5764bfbdff37 tempest-ProjectReaderTests-88753850 None] Created volume successfully. Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Acquiring lock "cinder-7afed4e2-4b84-4acb-83fd-e084438260fc-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "cinder-7afed4e2-4b84-4acb-83fd-e084438260fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Acquiring lock "cinder-quobyte-7afed4e2-4b84-4acb-83fd-e084438260fc" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "cinder-quobyte-7afed4e2-4b84-4acb-83fd-e084438260fc" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd95b7-f826-4d0b-8c48-51b86b64e415]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:59 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc Jul 23 03:31:59 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:59 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:59 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc Jul 23 03:31:59 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:59 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-7afed4e2-4b84-4acb-83fd-e084438260fc" returned: 0 in 0.259s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "cinder-quobyte-7afed4e2-4b84-4acb-83fd-e084438260fc" released by "delete_volume" :: held 0.659s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Created reservations ['8e5958d9-5151-4e49-a09e-2ac9291f1b31', '461e637a-701d-47f7-9fc7-744ef2bf382e', 'd2b89c18-fb70-4a73-95a4-2d6e2366582a', '7baa90ac-fcba-4798-b841-55015fd7f3fb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:00 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:00 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:00 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.228s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Deleted volume successfully. Jul 23 03:32:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a597a0d8-8b96-47cf-9864-c5011f82cb33 tempest-ProjectReaderTests-88753850 None] Lock "cinder-7afed4e2-4b84-4acb-83fd-e084438260fc-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (bfbf0e74-ba9d-4492-91ef-0cef2201b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caace62e-8a20-4ce4-9503-0c53b89f16fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caace62e-8a20-4ce4-9503-0c53b89f16fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968465478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316af35a-6ef7-436e-af0d-7d894bd34bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:04Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f36cf6e-dafd-49ff-a43e-4c9b59333991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f36cf6e-dafd-49ff-a43e-4c9b59333991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d403360-7257-47fd-917e-bd3bdd2fdec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d403360-7257-47fd-917e-bd3bdd2fdec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316af35a-6ef7-436e-af0d-7d894bd34bd9', 'volume_name': 'volume-316af35a-6ef7-436e-af0d-7d894bd34bd9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb0979-6927-4563-a15f-3c132c0ba32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb0979-6927-4563-a15f-3c132c0ba32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382b5d5-8fb8-4bc0-9038-05fce14f5ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Volume 316af35a-6ef7-436e-af0d-7d894bd34bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316af35a-6ef7-436e-af0d-7d894bd34bd9', 'volume_size': 1} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968465478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316af35a-6ef7-436e-af0d-7d894bd34bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:04Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Creating volume 316af35a-6ef7-436e-af0d-7d894bd34bd9 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:04 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 1073741824 Jul 23 03:32:04 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:04 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 1073741824" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:04 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 Jul 23 03:32:04 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:04 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9" returned: 0 in 0.234s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382b5d5-8fb8-4bc0-9038-05fce14f5ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316af35a-6ef7-436e-af0d-7d894bd34bd9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43612de-5020-466f-8a0f-750cb09d02d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Volume volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 (316af35a-6ef7-436e-af0d-7d894bd34bd9): created successfully Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43612de-5020-466f-8a0f-750cb09d02d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (bfbf0e74-ba9d-4492-91ef-0cef2201b413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-311a228f-6054-4cb4-b526-379e8e595ed9 tempest-ProjectReaderTests-504883976 None] Created volume successfully. Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-316af35a-6ef7-436e-af0d-7d894bd34bd9-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "cinder-316af35a-6ef7-436e-af0d-7d894bd34bd9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-quobyte-316af35a-6ef7-436e-af0d-7d894bd34bd9" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-316af35a-6ef7-436e-af0d-7d894bd34bd9" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9106efeb-1b99-483e-ad5a-46321587e49f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 Jul 23 03:32:05 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9 Jul 23 03:32:05 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-316af35a-6ef7-436e-af0d-7d894bd34bd9" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-316af35a-6ef7-436e-af0d-7d894bd34bd9" released by "delete_volume" :: held 0.696s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Created reservations ['ca9e6e2d-fbc2-4df1-99df-54cfc453cb8e', 'b7c67216-59d3-421a-86de-2d7da1bc0e03', '4e75a209-a146-43e6-994f-26e14cf789e9', 'e57837ba-0a9f-41bd-a5fd-3c36a37e15c7'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:05 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:06 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Deleted volume successfully. Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f57bc076-fb36-4922-8003-5b23136ace41 tempest-ProjectReaderTests-504883976 None] Lock "cinder-316af35a-6ef7-436e-af0d-7d894bd34bd9-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (e5849461-e48f-40c6-b876-7ce750421750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc29946-d96e-4cbb-b395-34d97749ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc29946-d96e-4cbb-b395-34d97749ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713431890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d174031-0ed2-4a40-80ca-91b619ba135d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:07Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf056603-46a2-4c88-a933-e5d7eb6e6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf056603-46a2-4c88-a933-e5d7eb6e6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993fe1f-fd28-454b-9c65-72b944b07ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993fe1f-fd28-454b-9c65-72b944b07ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d174031-0ed2-4a40-80ca-91b619ba135d', 'volume_name': 'volume-4d174031-0ed2-4a40-80ca-91b619ba135d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffef4b0-3fbf-40bf-a983-a43899fa4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffef4b0-3fbf-40bf-a983-a43899fa4915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6b5556-57f2-4c0f-9bbe-8641d7148cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:06 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Volume 4d174031-0ed2-4a40-80ca-91b619ba135d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d174031-0ed2-4a40-80ca-91b619ba135d', 'volume_size': 1} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713431890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d174031-0ed2-4a40-80ca-91b619ba135d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:07Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Creating volume 4d174031-0ed2-4a40-80ca-91b619ba135d {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:06 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:32:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:06 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d 1073741824 Jul 23 03:32:06 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:07 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d 1073741824" returned: 0 in 0.420s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:07 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d Jul 23 03:32:07 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:07 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d" returned: 0 in 0.237s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6b5556-57f2-4c0f-9bbe-8641d7148cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d174031-0ed2-4a40-80ca-91b619ba135d', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384c612e-dd2a-43e6-8829-98709e9b9a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:07 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Volume volume-4d174031-0ed2-4a40-80ca-91b619ba135d (4d174031-0ed2-4a40-80ca-91b619ba135d): created successfully Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384c612e-dd2a-43e6-8829-98709e9b9a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (e5849461-e48f-40c6-b876-7ce750421750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f362c881-33be-4507-b5de-0414c9c89dff tempest-ProjectReaderTests-504883976 None] Created volume successfully. Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-4d174031-0ed2-4a40-80ca-91b619ba135d-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "cinder-4d174031-0ed2-4a40-80ca-91b619ba135d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-quobyte-4d174031-0ed2-4a40-80ca-91b619ba135d" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-4d174031-0ed2-4a40-80ca-91b619ba135d" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d216a62-b0d9-45f8-b3fe-167df882e9e2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:07 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d Jul 23 03:32:07 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d" returned: 0 in 0.350s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:08 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d Jul 23 03:32:08 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4d174031-0ed2-4a40-80ca-91b619ba135d" returned: 0 in 0.232s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-4d174031-0ed2-4a40-80ca-91b619ba135d" released by "delete_volume" :: held 0.620s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Created reservations ['30ef1cb7-891e-407e-b796-2b9d8cad3dbb', 'b6fec106-871f-45e5-93cc-a5de923b91a2', '0df19813-53df-4e56-a3fc-7dc3fdd277b0', '401843b9-a8e3-4330-a59d-816253864fcf'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:08 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:08 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Deleted volume successfully. Jul 23 03:32:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f9b3e7da-6de9-40bf-976a-b3fa62de5d9d tempest-ProjectReaderTests-504883976 None] Lock "cinder-4d174031-0ed2-4a40-80ca-91b619ba135d-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (cf6b05f8-918b-4068-8f4c-a2831d2a9059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac8934-0370-41c9-9f95-a3f47868d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac8934-0370-41c9-9f95-a3f47868d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98619445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6b3795-bdc5-4ad1-b9b2-98151c59983e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:09Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb5f09b-2a68-41d5-8203-6bd8466a5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb5f09b-2a68-41d5-8203-6bd8466a5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ff3384-ccb8-4919-8615-ed1f640aca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ff3384-ccb8-4919-8615-ed1f640aca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6b3795-bdc5-4ad1-b9b2-98151c59983e', 'volume_name': 'volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a76aa0d-070e-4b64-940e-3d231d294b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a76aa0d-070e-4b64-940e-3d231d294b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac17359d-b713-4fd2-9c28-a0acdd04b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Volume de6b3795-bdc5-4ad1-b9b2-98151c59983e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e', 'volume_size': 1} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98619445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6b3795-bdc5-4ad1-b9b2-98151c59983e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:09Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Creating volume de6b3795-bdc5-4ad1-b9b2-98151c59983e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:09 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:09 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e 1073741824 Jul 23 03:32:09 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:09 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e 1073741824" returned: 0 in 0.423s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:09 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e Jul 23 03:32:09 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:10 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e" returned: 0 in 0.238s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac17359d-b713-4fd2-9c28-a0acdd04b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763b1602-3a36-4b1e-83b3-2b1fa83656a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:10 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Volume volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e (de6b3795-bdc5-4ad1-b9b2-98151c59983e): created successfully Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763b1602-3a36-4b1e-83b3-2b1fa83656a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (cf6b05f8-918b-4068-8f4c-a2831d2a9059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7d306f59-c758-4908-9fe6-6417af50f355 tempest-ProjectReaderTests-504883976 None] Created volume successfully. Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-de6b3795-bdc5-4ad1-b9b2-98151c59983e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "cinder-de6b3795-bdc5-4ad1-b9b2-98151c59983e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-quobyte-de6b3795-bdc5-4ad1-b9b2-98151c59983e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-de6b3795-bdc5-4ad1-b9b2-98151c59983e" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3112e179-d374-4bfd-8e24-fafca91df05b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:10 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e Jul 23 03:32:10 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:10 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:11 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e Jul 23 03:32:11 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:11 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-de6b3795-bdc5-4ad1-b9b2-98151c59983e" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-de6b3795-bdc5-4ad1-b9b2-98151c59983e" released by "delete_volume" :: held 0.686s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Created reservations ['11fe3d7f-1f3e-4f57-a937-41a9c834a9cf', '98080ffc-6767-49d8-b5ce-66f41bd77f11', '3d5dbaf5-d2a6-44a0-86c9-3eb5af2fd4e6', 'eba82efa-03fc-4348-bd2e-19ea468acc85'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:11 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:11 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:11 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Deleted volume successfully. Jul 23 03:32:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3f6b1b37-1dc2-453b-bc1c-4ab890b10af7 tempest-ProjectReaderTests-504883976 None] Lock "cinder-de6b3795-bdc5-4ad1-b9b2-98151c59983e-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (b7f94eb8-102c-4868-b57d-e9d52ddd7d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e9535-d1b0-499f-9d15-dac060da740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e9535-d1b0-499f-9d15-dac060da740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032498061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f475b147-8301-491a-a905-e728ee7ce5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:12Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69fdb17-18f1-49ab-bafa-fc48fc4d0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69fdb17-18f1-49ab-bafa-fc48fc4d0698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5358a843-6d66-48c4-bb15-d93bd340b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5358a843-6d66-48c4-bb15-d93bd340b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f475b147-8301-491a-a905-e728ee7ce5d3', 'volume_name': 'volume-f475b147-8301-491a-a905-e728ee7ce5d3', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742097fb-b819-4b0a-b57e-8bc5963f529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742097fb-b819-4b0a-b57e-8bc5963f529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbdfb9d-6a39-44cf-98a5-ff8970cf5d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Volume f475b147-8301-491a-a905-e728ee7ce5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f475b147-8301-491a-a905-e728ee7ce5d3', 'volume_size': 1} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032498061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f475b147-8301-491a-a905-e728ee7ce5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187acf395fc4470baf3c69ca74537d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:12Z,use_quota=True,user_id='cd3328ae4e8845a79be0babb5a70aecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Creating volume f475b147-8301-491a-a905-e728ee7ce5d3 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:12 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:32:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:12 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 1073741824 Jul 23 03:32:12 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:13 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 1073741824" returned: 0 in 0.475s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:13 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 Jul 23 03:32:13 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:13 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3" returned: 0 in 0.402s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbdfb9d-6a39-44cf-98a5-ff8970cf5d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f475b147-8301-491a-a905-e728ee7ce5d3', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb7e447-d552-455b-bdb1-d3d17e27e31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-0e2562d6-c078-4589-a1cc-393702c8337b tempest-TestShelveInstance-1346632330 None] Terminate volume connection completed successfully. Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-0e2562d6-c078-4589-a1cc-393702c8337b tempest-TestShelveInstance-1346632330 None] Deleting attachment cd56cd62-de0c-4179-a008-d741b426906f. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:32:13 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Volume volume-f475b147-8301-491a-a905-e728ee7ce5d3 (f475b147-8301-491a-a905-e728ee7ce5d3): created successfully Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb7e447-d552-455b-bdb1-d3d17e27e31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Flow 'volume_create_manager' (b7f94eb8-102c-4868-b57d-e9d52ddd7d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41232eb3-dba7-4c4d-813f-5d7660760bc7 tempest-ProjectReaderTests-504883976 None] Created volume successfully. Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Acquiring lock "cinder-e8b8a728-356f-4ce8-8e8b-bc527a797d30-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "cinder-e8b8a728-356f-4ce8-8e8b-bc527a797d30-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Acquiring lock "cinder-quobyte-e8b8a728-356f-4ce8-8e8b-bc527a797d30" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "cinder-quobyte-e8b8a728-356f-4ce8-8e8b-bc527a797d30" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60c3d13-1b05-4b89-8326-dfc2315b51b7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:13 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 Jul 23 03:32:13 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:14 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:14 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30 Jul 23 03:32:14 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-f475b147-8301-491a-a905-e728ee7ce5d3-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "cinder-f475b147-8301-491a-a905-e728ee7ce5d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:14 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Acquiring lock "cinder-quobyte-f475b147-8301-491a-a905-e728ee7ce5d3" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e8b8a728-356f-4ce8-8e8b-bc527a797d30" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "cinder-quobyte-e8b8a728-356f-4ce8-8e8b-bc527a797d30" released by "delete_volume" :: held 0.749s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-f475b147-8301-491a-a905-e728ee7ce5d3" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1694749c-427f-40a2-a652-75a8361b1ba6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.quota [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Created reservations ['67a512b8-e185-4b90-8b29-ecc52acaeb76', '0ed77332-c79b-42fb-af3d-3a7cc155d910', '951d958f-506c-49f4-900b-fa23261c3975', 'ba6c4b74-4d96-4e34-9508-4680417a50bb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:14 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 Jul 23 03:32:14 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:14 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:14 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:14 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.302s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.manager [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Deleted volume successfully. Jul 23 03:32:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [req-a0584dd4-faca-4fa1-bb5e-884e69eff8c4 req-c93896b2-c089-4310-bcc6-e83bb2b5a018 tempest-TestShelveInstance-1346632330 None] Lock "cinder-e8b8a728-356f-4ce8-8e8b-bc527a797d30-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:15 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3" returned: 0 in 0.502s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:15 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3 Jul 23 03:32:15 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:15 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-f475b147-8301-491a-a905-e728ee7ce5d3" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "cinder-quobyte-f475b147-8301-491a-a905-e728ee7ce5d3" released by "delete_volume" :: held 0.795s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Created reservations ['75fc4fc7-3920-45fa-bd7e-1a8ce6650e62', 'd0d4e35d-3351-4c66-93c4-c4637789f26f', '74235089-c1fa-4412-b2e2-81bcabd22f26', 'c304e2cd-7922-4130-8881-eabab79186c0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:15 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:15 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:15 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.282s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Deleted volume successfully. Jul 23 03:32:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19b77dd5-d90c-44f7-ad12-1ca797e4e0a5 tempest-ProjectReaderTests-504883976 None] Lock "cinder-f475b147-8301-491a-a905-e728ee7ce5d3-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:22 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=85,cinder:INSERT=21,cinder:UPDATE=110,cinder:DELETE=11 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=77,cinder:UPDATE=105,cinder:INSERT=29,cinder:DELETE=8 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:44 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Flow 'volume_create_manager' (f52bdf66-916b-4a93-ac8f-51df1551bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82682fe2-fad7-4e65-b441-82452a53fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82682fe2-fad7-4e65-b441-82452a53fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1491455022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a598454-3d80-427b-8d58-59fdf72dc354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fb92bb505a4b108c9d33b820fdc11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:45Z,use_quota=True,user_id='6d6f1a41c1e04430b0297be9a8a3940b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfa0a6-1a1e-4154-879b-57bbd6892c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfa0a6-1a1e-4154-879b-57bbd6892c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80214dd-bd97-4cd7-a619-7bf2afbd2d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80214dd-bd97-4cd7-a619-7bf2afbd2d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a598454-3d80-427b-8d58-59fdf72dc354', 'volume_name': 'volume-4a598454-3d80-427b-8d58-59fdf72dc354', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a41c33b-a241-4ceb-9edb-abef6fd41618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a41c33b-a241-4ceb-9edb-abef6fd41618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea0a72-6b91-4e09-95bd-2054696523c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Volume 4a598454-3d80-427b-8d58-59fdf72dc354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a598454-3d80-427b-8d58-59fdf72dc354', 'volume_size': 1} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1491455022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a598454-3d80-427b-8d58-59fdf72dc354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fb92bb505a4b108c9d33b820fdc11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:45Z,use_quota=True,user_id='6d6f1a41c1e04430b0297be9a8a3940b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Creating volume 4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:45 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 1073741824 Jul 23 03:32:45 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 1073741824" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:32:45 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea0a72-6b91-4e09-95bd-2054696523c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a598454-3d80-427b-8d58-59fdf72dc354', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f4e001-d0a9-4cf1-a2ed-2d1d17a1ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Volume volume-4a598454-3d80-427b-8d58-59fdf72dc354 (4a598454-3d80-427b-8d58-59fdf72dc354): created successfully Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f4e001-d0a9-4cf1-a2ed-2d1d17a1ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Flow 'volume_create_manager' (f52bdf66-916b-4a93-ac8f-51df1551bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-df606293-151d-464a-b693-09faa5ce0769 tempest-TestStampPattern-551838506 None] Created volume successfully. Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:47 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:32:47 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:32:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:32:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:55 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-8bfe6263-02a7-4ac2-a241-b5605aff47f3 req-67e10535-e736-4984-9539-66bb13a50d6c tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-8bfe6263-02a7-4ac2-a241-b5605aff47f3 req-67e10535-e736-4984-9539-66bb13a50d6c tempest-TestStampPattern-551838506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-8bfe6263-02a7-4ac2-a241-b5605aff47f3 req-67e10535-e736-4984-9539-66bb13a50d6c tempest-TestStampPattern-551838506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-8bfe6263-02a7-4ac2-a241-b5605aff47f3 req-67e10535-e736-4984-9539-66bb13a50d6c tempest-TestStampPattern-551838506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-4a598454-3d80-427b-8d58-59fdf72dc354', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77e146d1-1631-428f-b502-b9e822dffbf0', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:33:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-8bfe6263-02a7-4ac2-a241-b5605aff47f3 req-67e10535-e736-4984-9539-66bb13a50d6c tempest-TestStampPattern-551838506 None] attachment_update completed successfully. Jul 23 03:33:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-f62632f9-71b3-4420-a0f9-3b53d493f578 req-330cddc1-903c-449c-9b5c-2ffb8ee79431 tempest-TestStampPattern-551838506 None] Terminate volume connection completed successfully. Jul 23 03:33:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-f62632f9-71b3-4420-a0f9-3b53d493f578 req-330cddc1-903c-449c-9b5c-2ffb8ee79431 tempest-TestStampPattern-551838506 None] Deleting attachment 77e146d1-1631-428f-b502-b9e822dffbf0. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Creating offline snapshot 23efc420-1695-4f52-bdd7-4ec8e6f90f8d of volume 4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a37c74-9b26-4910-af6a-259261d484a1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:21 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:33:21 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:21 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:21 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d 1G Jul 23 03:33:21 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:21 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d 1G" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a598454-3d80-427b-8d58-59fdf72dc354 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:21 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a598454-3d80-427b-8d58-59fdf72dc354 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:33:21 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:22 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a598454-3d80-427b-8d58-59fdf72dc354 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.282s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:22 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d is being set with open permissions: ugo+rw Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:22 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:33:22 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:22 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:22 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info Jul 23 03:33:22 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:22 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:22 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info is being set with open permissions: ugo+rw Jul 23 03:33:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:22 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info Jul 23 03:33:22 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:23 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.info" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-779cf145-29bd-49ef-8642-ec67ab9e16f4 tempest-TestStampPattern-551838506 None] Create snapshot completed successfully Jul 23 03:33:29 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Flow 'volume_create_manager' (72d6d696-79ad-41f4-97f4-c8d1ae1b4cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa5b4f9-75b1-48a0-a95d-5512199002a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa5b4f9-75b1-48a0-a95d-5512199002a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1601637342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152aeccd-f10f-44fd-9425-64e34b686f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fb92bb505a4b108c9d33b820fdc11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23efc420-1695-4f52-bdd7-4ec8e6f90f8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:30Z,use_quota=True,user_id='6d6f1a41c1e04430b0297be9a8a3940b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d600add4-3027-48bc-8e43-b2766e8a0480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d600add4-3027-48bc-8e43-b2766e8a0480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f13eed-a96b-4173-bedf-25ea6b4e9d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f13eed-a96b-4173-bedf-25ea6b4e9d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '152aeccd-f10f-44fd-9425-64e34b686f49', 'volume_name': 'volume-152aeccd-f10f-44fd-9425-64e34b686f49', 'volume_size': 1, 'snapshot_id': '23efc420-1695-4f52-bdd7-4ec8e6f90f8d'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f795db-0361-45c5-baee-fdefb6234393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f795db-0361-45c5-baee-fdefb6234393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ca09c-f298-493a-91d4-44d79c646bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:30 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Volume 152aeccd-f10f-44fd-9425-64e34b686f49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-152aeccd-f10f-44fd-9425-64e34b686f49', 'volume_size': 1, 'snapshot_id': '23efc420-1695-4f52-bdd7-4ec8e6f90f8d'} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-152aeccd-f10f-44fd-9425-64e34b686f49" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-152aeccd-f10f-44fd-9425-64e34b686f49" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Creating volume 152aeccd-f10f-44fd-9425-64e34b686f49 from snapshot 23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] snapshot: 23efc420-1695-4f52-bdd7-4ec8e6f90f8d, volume: 152aeccd-f10f-44fd-9425-64e34b686f49, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8fda8-0025-4e39-8ccd-933abb988d3f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:33:30 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a598454-3d80-427b-8d58-59fdf72dc354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cbab6f-a80f-4260-a1d5-a337cf5152eb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:33:30 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:33:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 Jul 23 03:33:30 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49" returned: 0 in 5.202s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb273502-85b5-4b55-ba8d-f8139af0aba2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:33:36 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.580s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:33:36 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Converted 1024.00 MB image at 196.78 MB/s Jul 23 03:33:36 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 is being set with open permissions: ugo+rw Jul 23 03:33:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 Jul 23 03:33:36 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:37 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" released by "_copy_volume_from_snapshot" :: held 6.964s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-152aeccd-f10f-44fd-9425-64e34b686f49" released by "_create_volume_from_snapshot" :: held 6.998s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.016s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ca09c-f298-493a-91d4-44d79c646bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152aeccd-f10f-44fd-9425-64e34b686f49', 'volume_size': 1, 'snapshot_id': '23efc420-1695-4f52-bdd7-4ec8e6f90f8d'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac32b3-180d-46d7-b942-62c9441adb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Volume volume-152aeccd-f10f-44fd-9425-64e34b686f49 (152aeccd-f10f-44fd-9425-64e34b686f49): created successfully Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac32b3-180d-46d7-b942-62c9441adb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Flow 'volume_create_manager' (72d6d696-79ad-41f4-97f4-c8d1ae1b4cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:37 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6487dae0-2951-47a2-971d-aa9dec8ec845 tempest-TestStampPattern-551838506 None] Created volume successfully. Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:47 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:33:47 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:48 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:33:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbccb38a-8bac-464e-9235-a1e6114462a5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 Jul 23 03:34:19 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:19 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49" returned: 0 in 0.351s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.378s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8', 'name': 'volume-152aeccd-f10f-44fd-9425-64e34b686f49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4165f1f6-285b-4eed-b3ef-9e2e817e8a10', 'enforce_multipath': True} {{(pid=88466) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:34:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-b68c3162-8d66-492c-b7e6-366c6130ebcc req-d69d8786-cfd9-43d6-b44d-a6903df68c78 tempest-TestStampPattern-551838506 None] attachment_update completed successfully. Jul 23 03:34:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [req-71f18cf1-10be-414c-aacd-57337775697a req-7be71b12-3f98-4ad2-9aa9-7022c68dd2e7 tempest-TestStampPattern-551838506 None] Terminate volume connection completed successfully. Jul 23 03:34:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [req-71f18cf1-10be-414c-aacd-57337775697a req-7be71b12-3f98-4ad2-9aa9-7022c68dd2e7 tempest-TestStampPattern-551838506 None] Deleting attachment 4165f1f6-285b-4eed-b3ef-9e2e817e8a10. {{(pid=88466) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-152aeccd-f10f-44fd-9425-64e34b686f49-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "cinder-152aeccd-f10f-44fd-9425-64e34b686f49-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" acquired by "delete_volume" :: waited 0.013s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed4f79-acd4-466d-b5ea-d57abb5037ba]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 Jul 23 03:34:27 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49 Jul 23 03:34:27 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-152aeccd-f10f-44fd-9425-64e34b686f49" returned: 0 in 0.234s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-152aeccd-f10f-44fd-9425-64e34b686f49" released by "delete_volume" :: held 0.609s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Created reservations ['1489cce1-a63a-436f-92b9-ff3777524da6', '9df17db2-0222-4724-b73f-bbfc25b65029', '4748c4bc-e542-49df-a075-b7e162afff10', 'b5afe346-1988-49be-ad89-3564eb8fc636'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:34:27 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Deleted volume successfully. Jul 23 03:34:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0366b813-1a5e-4447-bbcb-8068ba6a44c5 tempest-TestStampPattern-551838506 None] Lock "cinder-152aeccd-f10f-44fd-9425-64e34b686f49-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Deleting offline snapshot 23efc420-1695-4f52-bdd7-4ec8e6f90f8d of volume 4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] snapshot_file for this snap is: volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9a131-f619-416f-87ec-f097c4765980]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:34:28 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.373s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a598454-3d80-427b-8d58-59fdf72dc354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d039496-31de-4a4e-bf7b-7ee0fc75d169]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:34:28 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:34:29 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d Jul 23 03:34:29 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354.23efc420-1695-4f52-bdd7-4ec8e6f90f8d" returned: 0 in 0.244s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-23efc420-1695-4f52-bdd7-4ec8e6f90f8d" released by "_delete_snapshot" :: held 1.412s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" released by "delete_snapshot" :: held 1.435s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Created reservations ['43ebf9cf-a09d-4283-8ef9-13c09e09fefb', '9fa3e867-808c-4c30-a2ac-96080efc0430', '50b1029e-fc94-46c2-aac7-92fb4bbda561', '076e3643-ba51-4dce-aa69-c91713ac212e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Delete snapshot completed successfully. Jul 23 03:34:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4040b18d-8116-416b-bf4f-9f993bf6cb27 tempest-TestStampPattern-551838506 None] Lock "cinder-23efc420-1695-4f52-bdd7-4ec8e6f90f8d-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-4a598454-3d80-427b-8d58-59fdf72dc354-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "cinder-4a598454-3d80-427b-8d58-59fdf72dc354-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Acquiring lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e00c1-ddab-4729-8cf0-4b2d0dd93992]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:34:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.362s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354 Jul 23 03:34:34 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-4a598454-3d80-427b-8d58-59fdf72dc354" returned: 0 in 0.238s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "cinder-quobyte-4a598454-3d80-427b-8d58-59fdf72dc354" released by "delete_volume" :: held 0.654s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Created reservations ['382630b4-a1c8-4910-94fe-70a89c7634f9', 'dc6f7646-6271-4350-a284-9df0068de5bc', '36808625-5c5c-4087-a573-cefea4cbb7fb', '8a9b957b-9b5c-415c-864d-688572ec7e12'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:34:34 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Deleted volume successfully. Jul 23 03:34:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3cb5b13-eeff-4b17-bafc-5c1a18c79d72 tempest-TestStampPattern-551838506 None] Lock "cinder-4a598454-3d80-427b-8d58-59fdf72dc354-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:44 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:45 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:47 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:34:47 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:48 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:34:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Flow 'volume_create_manager' (ed0f16e7-c9c3-4b87-8dda-1f7acbd69c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef150823-b619-4fc8-aa42-78e4c31305ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef150823-b619-4fc8-aa42-78e4c31305ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1991935603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e45003-7465-415a-acdb-c0d8645d54ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165b181bd233458888b91ab58aa39bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:03Z,use_quota=True,user_id='588660cda9e54051a7faccf011f5d5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba398a7-bb1f-4ca9-8a2a-edffe661a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba398a7-bb1f-4ca9-8a2a-edffe661a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ec4c96-ae35-4427-9d30-522171c43dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ec4c96-ae35-4427-9d30-522171c43dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e45003-7465-415a-acdb-c0d8645d54ca', 'volume_name': 'volume-b0e45003-7465-415a-acdb-c0d8645d54ca', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf06993-6ce5-4689-8eae-ef9a1ddb7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf06993-6ce5-4689-8eae-ef9a1ddb7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a080920e-f445-4e6f-a7c1-490a71866eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Volume b0e45003-7465-415a-acdb-c0d8645d54ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e45003-7465-415a-acdb-c0d8645d54ca', 'volume_size': 1} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1991935603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e45003-7465-415a-acdb-c0d8645d54ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165b181bd233458888b91ab58aa39bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:03Z,use_quota=True,user_id='588660cda9e54051a7faccf011f5d5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Creating volume b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:03 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca 1073741824 Jul 23 03:35:03 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca 1073741824" returned: 0 in 0.392s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:03 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a080920e-f445-4e6f-a7c1-490a71866eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e45003-7465-415a-acdb-c0d8645d54ca', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389eaaf1-e002-4356-80f0-e87aa3158a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Volume volume-b0e45003-7465-415a-acdb-c0d8645d54ca (b0e45003-7465-415a-acdb-c0d8645d54ca): created successfully Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389eaaf1-e002-4356-80f0-e87aa3158a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Flow 'volume_create_manager' (ed0f16e7-c9c3-4b87-8dda-1f7acbd69c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-941e948f-4145-4cfd-abb0-938a02e87a29 tempest-SnapshotDependencyTests-1881362804 None] Created volume successfully. Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Creating offline snapshot 2024de80-af5c-41f0-94dd-8bb25201563e of volume b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb07b4-1be5-4043-894d-1e9c391d2b6c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:04 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.358s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e 1G Jul 23 03:35:04 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:05 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e 1G" returned: 0 in 0.382s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e45003-7465-415a-acdb-c0d8645d54ca -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:05 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e45003-7465-415a-acdb-c0d8645d54ca -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:05 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:05 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0e45003-7465-415a-acdb-c0d8645d54ca -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e is being set with open permissions: ugo+rw Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:05 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:05 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:05 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.227s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:05 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info Jul 23 03:35:05 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:05 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info" returned: 0 in 0.237s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info is being set with open permissions: ugo+rw Jul 23 03:35:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:05 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info Jul 23 03:35:05 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:06 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.info" returned: 0 in 0.227s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-96a5db70-1533-49b6-bbd2-6163c1490cd6 tempest-SnapshotDependencyTests-1881362804 None] Create snapshot completed successfully Jul 23 03:35:06 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Flow 'volume_create_manager' (e4a96371-0b0f-4675-ac95-b83af19f63ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f63096-e164-419e-817f-5c7daa97a988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f63096-e164-419e-817f-5c7daa97a988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f9742-64a2-4762-bd4e-9963b270ea62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165b181bd233458888b91ab58aa39bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2024de80-af5c-41f0-94dd-8bb25201563e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:07Z,use_quota=True,user_id='588660cda9e54051a7faccf011f5d5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7de5e7-95f4-4856-a715-a491ee4afbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7de5e7-95f4-4856-a715-a491ee4afbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109cf6ca-68e1-454d-95c4-40036cd122b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109cf6ca-68e1-454d-95c4-40036cd122b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '100f9742-64a2-4762-bd4e-9963b270ea62', 'volume_name': 'volume-100f9742-64a2-4762-bd4e-9963b270ea62', 'volume_size': 1, 'snapshot_id': '2024de80-af5c-41f0-94dd-8bb25201563e'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658d3635-4a52-4b4e-b585-c496e0b1cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658d3635-4a52-4b4e-b585-c496e0b1cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d0dd7d-1c65-442f-b970-76655502fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Volume 100f9742-64a2-4762-bd4e-9963b270ea62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-100f9742-64a2-4762-bd4e-9963b270ea62', 'volume_size': 1, 'snapshot_id': '2024de80-af5c-41f0-94dd-8bb25201563e'} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e-100f9742-64a2-4762-bd4e-9963b270ea62" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e-100f9742-64a2-4762-bd4e-9963b270ea62" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Creating volume 100f9742-64a2-4762-bd4e-9963b270ea62 from snapshot 2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] snapshot: 2024de80-af5c-41f0-94dd-8bb25201563e, volume: 100f9742-64a2-4762-bd4e-9963b270ea62, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268e48d-6079-45d9-8098-41dd929a768d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:07 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:07 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.336s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e45003-7465-415a-acdb-c0d8645d54ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c79311-0588-4fce-8ef6-6df5b3506d72]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:07 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:07 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:35:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 Jul 23 03:35:07 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:11 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62" returned: 0 in 3.923s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:11 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[51311fad-2d78-4786-bb51-fe313dff83fb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:11 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:11 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:12 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.517s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:35:12 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Converted 1024.00 MB image at 260.97 MB/s Jul 23 03:35:12 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 is being set with open permissions: ugo+rw Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:12 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 Jul 23 03:35:12 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:12 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62" returned: 0 in 0.227s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" released by "_copy_volume_from_snapshot" :: held 5.421s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e-100f9742-64a2-4762-bd4e-9963b270ea62" released by "_create_volume_from_snapshot" :: held 5.450s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.463s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d0dd7d-1c65-442f-b970-76655502fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100f9742-64a2-4762-bd4e-9963b270ea62', 'volume_size': 1, 'snapshot_id': '2024de80-af5c-41f0-94dd-8bb25201563e'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8718dd5-81da-4ddf-8f57-153110a23b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Volume volume-100f9742-64a2-4762-bd4e-9963b270ea62 (100f9742-64a2-4762-bd4e-9963b270ea62): created successfully Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8718dd5-81da-4ddf-8f57-153110a23b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Flow 'volume_create_manager' (e4a96371-0b0f-4675-ac95-b83af19f63ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c435f3ab-1387-46d4-9ffe-f6cc1957c0cc tempest-SnapshotDependencyTests-1881362804 None] Created volume successfully. Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-2024de80-af5c-41f0-94dd-8bb25201563e-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-2024de80-af5c-41f0-94dd-8bb25201563e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Deleting offline snapshot 2024de80-af5c-41f0-94dd-8bb25201563e of volume b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] snapshot_file for this snap is: volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[435518ca-948a-48e0-9649-7b5465df223b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:13 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:14 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.384s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0e45003-7465-415a-acdb-c0d8645d54ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[188ebea7-5d89-4bc9-a206-c4cbbfa24f06]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:14 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:14 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:14 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.373s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:14 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:14 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:14 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:14 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e Jul 23 03:35:14 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:14 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca.2024de80-af5c-41f0-94dd-8bb25201563e" returned: 0 in 0.238s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-2024de80-af5c-41f0-94dd-8bb25201563e" released by "_delete_snapshot" :: held 1.407s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" released by "delete_snapshot" :: held 1.435s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Created reservations ['2cb16aee-06d4-4869-91e2-fafb6729f70d', 'fc56582c-0fe8-40dc-b0a7-6666b4bf7e2f', 'f70e365b-c8ce-4548-8829-31bedd4e4c2f', '04f71286-979f-4c6c-a63c-2f3510ffeef5'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Delete snapshot completed successfully. Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f34c21eb-34f8-4c66-9aaf-16ecf1ebfd13 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-2024de80-af5c-41f0-94dd-8bb25201563e-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-b0e45003-7465-415a-acdb-c0d8645d54ca-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-b0e45003-7465-415a-acdb-c0d8645d54ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8830bc7e-0684-4c56-99aa-df4a8c065593]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:15 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:15 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.336s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:16 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca Jul 23 03:35:16 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b0e45003-7465-415a-acdb-c0d8645d54ca" returned: 0 in 0.222s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-b0e45003-7465-415a-acdb-c0d8645d54ca" released by "delete_volume" :: held 0.614s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Created reservations ['86f5430c-86b0-45e5-b285-de12e50c770a', '962827a3-4555-44d5-8451-0ebfb4327fe9', '84c1e660-7991-41f7-911e-cbf3440f5d1c', 'f2d0c598-9e87-4499-93d2-00cacecfbd8e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:16 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:16 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Deleted volume successfully. Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-8ada1570-aebb-46d1-8ccf-a090037ffd23 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-b0e45003-7465-415a-acdb-c0d8645d54ca-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-100f9742-64a2-4762-bd4e-9963b270ea62-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-100f9742-64a2-4762-bd4e-9963b270ea62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66b2b2-5341-4476-b0c4-50f641223f26]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 Jul 23 03:35:17 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62 Jul 23 03:35:17 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-100f9742-64a2-4762-bd4e-9963b270ea62" returned: 0 in 0.231s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-quobyte-100f9742-64a2-4762-bd4e-9963b270ea62" released by "delete_volume" :: held 0.615s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Created reservations ['487b6734-6e24-4d4f-8562-27a5e49e3b78', 'ce950f62-0351-4bb0-9cf5-fca50f5e8f9f', '1b10422a-4e6d-49cb-819d-44918dd8e897', '880736e5-bacf-4ac1-ac64-44836218c631'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:17 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.231s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Deleted volume successfully. Jul 23 03:35:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3fc26d8a-245a-4a3e-b8fb-ac3bb6305911 tempest-SnapshotDependencyTests-1881362804 None] Lock "cinder-100f9742-64a2-4762-bd4e-9963b270ea62-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:27 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=30,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=5 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:27 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=35,cinder:SELECT=17,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (b144f8a6-6a0a-41e3-bfbb-5f4d6fea3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05954df-41c6-4689-9f66-3b9b6f1dac2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05954df-41c6-4689-9f66-3b9b6f1dac2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907233576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b328e0f-d373-4f4d-b9aa-94706121583b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cca3e6-ee46-47e6-a323-d76482f4813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cca3e6-ee46-47e6-a323-d76482f4813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5aed9f-91be-45a1-a326-0f8b38566f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5aed9f-91be-45a1-a326-0f8b38566f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b328e0f-d373-4f4d-b9aa-94706121583b', 'volume_name': 'volume-6b328e0f-d373-4f4d-b9aa-94706121583b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614cae19-e905-4386-bcfe-fe8f0cd42ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614cae19-e905-4386-bcfe-fe8f0cd42ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7113aad-3890-40e5-afe7-19bc6496706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Volume 6b328e0f-d373-4f4d-b9aa-94706121583b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b328e0f-d373-4f4d-b9aa-94706121583b', 'volume_size': 1} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907233576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b328e0f-d373-4f4d-b9aa-94706121583b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Creating volume 6b328e0f-d373-4f4d-b9aa-94706121583b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:36 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:36 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b 1073741824 Jul 23 03:35:36 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (800c83e3-c59b-4df6-95a2-43fd54025fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347c6ee7-79cd-4132-b373-fc63bc65efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347c6ee7-79cd-4132-b373-fc63bc65efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366675468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060c2a76-4ec4-4c2c-a2e4-02a10b199ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c75daa-3994-4cf9-88ae-463c1d2757b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c75daa-3994-4cf9-88ae-463c1d2757b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4c673-8649-4cf7-bf90-f0f1b0069cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4c673-8649-4cf7-bf90-f0f1b0069cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060c2a76-4ec4-4c2c-a2e4-02a10b199ca0', 'volume_name': 'volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c87c8-d457-4806-8455-91eebda4a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c87c8-d457-4806-8455-91eebda4a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd49f5aa-9343-4e4b-a1f4-c74cbae659ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume 060c2a76-4ec4-4c2c-a2e4-02a10b199ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0', 'volume_size': 1} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (365f46c2-b4cd-4bb1-8be3-6adc34e7c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a6ed8-da39-4bca-9346-c504d70e6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16a6ed8-da39-4bca-9346-c504d70e6860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257674460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1c95be-25bb-45f2-9cfd-97fe8c02b282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73420923-9fb2-4f45-8d8f-48f367a91cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73420923-9fb2-4f45-8d8f-48f367a91cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b668bb7-b7f6-4253-a0ac-9dbbcb8516a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b668bb7-b7f6-4253-a0ac-9dbbcb8516a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1c95be-25bb-45f2-9cfd-97fe8c02b282', 'volume_name': 'volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ee8880-858b-43b1-a07d-4e03ec11a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ee8880-858b-43b1-a07d-4e03ec11a96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2110f5d4-efe5-426d-8b16-c90c11f54f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Volume 2c1c95be-25bb-45f2-9cfd-97fe8c02b282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282', 'volume_size': 1} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (35b2a99b-1673-4151-b237-9209e5a53687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9aa4d62-208e-4f76-bd4f-8ef188ff5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9aa4d62-208e-4f76-bd4f-8ef188ff5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567387561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c778ac1-eb0b-464f-bef3-44bedfef1590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d41e67-e0ad-4278-a070-99877b3ce6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d41e67-e0ad-4278-a070-99877b3ce6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97a85e2-af71-41eb-bbd4-2c5f0bbf3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97a85e2-af71-41eb-bbd4-2c5f0bbf3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c778ac1-eb0b-464f-bef3-44bedfef1590', 'volume_name': 'volume-3c778ac1-eb0b-464f-bef3-44bedfef1590', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11807165-b3e0-497c-b635-2b1c9b78ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11807165-b3e0-497c-b635-2b1c9b78ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:37 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8423c91-f952-4d87-9a6d-a08e223a444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Volume 3c778ac1-eb0b-464f-bef3-44bedfef1590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c778ac1-eb0b-464f-bef3-44bedfef1590', 'volume_size': 1} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b 1073741824" returned: 0 in 0.792s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:37 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b Jul 23 03:35:37 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:38 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366675468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060c2a76-4ec4-4c2c-a2e4-02a10b199ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume 060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:38 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7113aad-3890-40e5-afe7-19bc6496706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b328e0f-d373-4f4d-b9aa-94706121583b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 1073741824 Jul 23 03:35:38 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05470b3-f19d-4bcd-8cb6-669996d98673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Volume volume-6b328e0f-d373-4f4d-b9aa-94706121583b (6b328e0f-d373-4f4d-b9aa-94706121583b): created successfully Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05470b3-f19d-4bcd-8cb6-669996d98673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (b144f8a6-6a0a-41e3-bfbb-5f4d6fea3536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (7978bc2b-1ee1-40c3-a829-5387501c5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d33893-8a00-4b2f-a1bc-eeaf2ebd4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-22d2b8b9-ed38-464a-a2d7-1d378765b226 tempest-CreateVolumesFromImageTest-1222082838 None] Created volume successfully. Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d33893-8a00-4b2f-a1bc-eeaf2ebd4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-49893475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f85050-8aed-49d9-8de2-2b4eb0fe74dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:38Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e441ca-f048-4d55-bf78-10ba813c6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e441ca-f048-4d55-bf78-10ba813c6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28033fc1-af47-4a38-a2b2-5e758f3a9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28033fc1-af47-4a38-a2b2-5e758f3a9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f85050-8aed-49d9-8de2-2b4eb0fe74dd', 'volume_name': 'volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ff847-930f-49a3-9866-8bb18aa5a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ff847-930f-49a3-9866-8bb18aa5a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44f282a-bc72-4ef6-a52a-051a9b0032c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Volume 97f85050-8aed-49d9-8de2-2b4eb0fe74dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd', 'volume_size': 1} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (81a4adcf-c026-43b3-b470-fcbbc9ec2f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb2371-751d-4a72-b5ab-6cb98f47a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb2371-751d-4a72-b5ab-6cb98f47a236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421396036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd0b802-8339-4646-adfd-b778932758b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:38Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81038b9c-cf17-4713-9eb1-3f3b92ca0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81038b9c-cf17-4713-9eb1-3f3b92ca0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e13dd5-3ea9-4f0c-9287-7bfc311c2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e13dd5-3ea9-4f0c-9287-7bfc311c2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd0b802-8339-4646-adfd-b778932758b9', 'volume_name': 'volume-8bd0b802-8339-4646-adfd-b778932758b9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d51f8c-d865-422d-8fec-97cf5887a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d51f8c-d865-422d-8fec-97cf5887a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424a352b-bf0b-4b11-bfd0-69ea61c98b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:38 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Volume 8bd0b802-8339-4646-adfd-b778932758b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd0b802-8339-4646-adfd-b778932758b9', 'volume_size': 1} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:38 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 1073741824" returned: 0 in 0.648s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:38 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 Jul 23 03:35:38 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:39 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257674460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1c95be-25bb-45f2-9cfd-97fe8c02b282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Creating volume 2c1c95be-25bb-45f2-9cfd-97fe8c02b282 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:39 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd49f5aa-9343-4e4b-a1f4-c74cbae659ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 1073741824 Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec55726-7769-4d16-b24b-990d8762d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:39 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 (060c2a76-4ec4-4c2c-a2e4-02a10b199ca0): created successfully Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec55726-7769-4d16-b24b-990d8762d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (800c83e3-c59b-4df6-95a2-43fd54025fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-846c5e3a-da32-4aa2-97b8-78f545f76a41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:39 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 1073741824" returned: 0 in 0.604s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:39 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 Jul 23 03:35:39 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:40 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567387561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c778ac1-eb0b-464f-bef3-44bedfef1590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:37Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Creating volume 3c778ac1-eb0b-464f-bef3-44bedfef1590 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:40 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2110f5d4-efe5-426d-8b16-c90c11f54f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b30d5e-41c4-42d9-a364-0786025231c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 1073741824 Jul 23 03:35:40 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:40 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Volume volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 (2c1c95be-25bb-45f2-9cfd-97fe8c02b282): created successfully Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b30d5e-41c4-42d9-a364-0786025231c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (365f46c2-b4cd-4bb1-8be3-6adc34e7c08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:40 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-168d376d-ad2d-4b23-99cf-f9e94d91038c tempest-CreateVolumesFromImageTest-1222082838 None] Created volume successfully. Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Flow 'volume_create_manager' (623dcf52-4d40-4326-9fe4-f6abb4bafaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca6672-4a40-4bc8-a609-755b71efce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:40 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (7fe8fb98-ce82-464f-8bcc-727d26c93793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e660547-f923-4c2b-859d-b7f3147e3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 1073741824" returned: 0 in 0.765s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca6672-4a40-4bc8-a609-755b71efce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e8a9d-d03a-418c-93c0-02c1b23d4703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca751e9addd40789c3da424d673bf4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:40Z,use_quota=True,user_id='e778588e23e34e1297aed2a5a06a5bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3cd562-8646-45c4-9fca-ee4bf97ab1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3cd562-8646-45c4-9fca-ee4bf97ab1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a532f6f-a9b9-485a-bc17-ba4c0b1d2399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e660547-f923-4c2b-859d-b7f3147e3793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762948965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b63e74-d9d5-4a48-a36b-074eae08b454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ede7cc-29b0-447f-a18e-a49866550823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ede7cc-29b0-447f-a18e-a49866550823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e7933-c4ac-4059-bca1-15df080e36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e7933-c4ac-4059-bca1-15df080e36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b63e74-d9d5-4a48-a36b-074eae08b454', 'volume_name': 'volume-51b63e74-d9d5-4a48-a36b-074eae08b454', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f18368-20b0-444a-81d7-3837bbc14a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f18368-20b0-444a-81d7-3837bbc14a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b7c454-2882-4411-b86c-045ee8d80483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume 51b63e74-d9d5-4a48-a36b-074eae08b454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b63e74-d9d5-4a48-a36b-074eae08b454', 'volume_size': 1} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (c7b41370-d54e-4139-8fda-4fd523327b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fca2ddb-e2ed-4887-9828-c6ed33476a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (089c9203-298b-41f0-8749-ca9360ee1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1908db-0938-408c-bad2-a902896d2242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fca2ddb-e2ed-4887-9828-c6ed33476a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712754812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd7197-84b8-49d0-8d27-6abf5d8bd67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092dc15-4930-4255-bc1e-e94ea14adfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092dc15-4930-4255-bc1e-e94ea14adfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d07ac0d-1956-4655-bc3e-b1943ee3e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d07ac0d-1956-4655-bc3e-b1943ee3e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50dd7197-84b8-49d0-8d27-6abf5d8bd67c', 'volume_name': 'volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862aa800-4d72-43a9-b9b3-46ebca2acaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862aa800-4d72-43a9-b9b3-46ebca2acaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f396ff8e-2f34-434a-9bd6-8f20ad2bc56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume 50dd7197-84b8-49d0-8d27-6abf5d8bd67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c', 'volume_size': 1} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1908db-0938-408c-bad2-a902896d2242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673605385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af06dc33-aa2a-45b5-b1a0-67f8cb083d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28004f95-bd83-4d6a-b637-c11753f30479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28004f95-bd83-4d6a-b637-c11753f30479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f74445-d8f7-42c2-92ca-db58073bc223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f74445-d8f7-42c2-92ca-db58073bc223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af06dc33-aa2a-45b5-b1a0-67f8cb083d0c', 'volume_name': 'volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210e073-b2ff-4a84-9cbe-031800119bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210e073-b2ff-4a84-9cbe-031800119bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0258c48d-99ea-44e6-adec-3181f5dc5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume af06dc33-aa2a-45b5-b1a0-67f8cb083d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c', 'volume_size': 1} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 Jul 23 03:35:41 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.391s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-49893475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f85050-8aed-49d9-8de2-2b4eb0fe74dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:38Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Creating volume 97f85050-8aed-49d9-8de2-2b4eb0fe74dd {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a532f6f-a9b9-485a-bc17-ba4c0b1d2399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b2e8a9d-d03a-418c-93c0-02c1b23d4703', 'volume_name': 'volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703', 'volume_size': 1, 'image_id': '83677f79-26f5-43d3-912a-8524a58b7415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f0c7f327d28c5c237269b5c5dfe236c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ca751e9addd40789c3da424d673bf4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e1b450d6d09f8e63da003302b83207d01b137b74462704ef21d3f6e1b30ac3f602ffe5df3c75b622c7ead7a997f322f1be3029c8da8021bc07471fb67108e90', 'id': '83677f79-26f5-43d3-912a-8524a58b7415', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83677f79-26f5-43d3-912a-8524a58b7415/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd 1073741824 Jul 23 03:35:41 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e742d-5db9-4c78-b53f-6a7c9ba953d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e742d-5db9-4c78-b53f-6a7c9ba953d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb65b0fa-4202-4bdb-afcd-b172d01a3217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703', 'volume_size': 1, 'image_id': '83677f79-26f5-43d3-912a-8524a58b7415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f0c7f327d28c5c237269b5c5dfe236c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ca751e9addd40789c3da424d673bf4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e1b450d6d09f8e63da003302b83207d01b137b74462704ef21d3f6e1b30ac3f602ffe5df3c75b622c7ead7a997f322f1be3029c8da8021bc07471fb67108e90', 'id': '83677f79-26f5-43d3-912a-8524a58b7415', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83677f79-26f5-43d3-912a-8524a58b7415/file', 'properties': {}}, 'image_service': } Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Trying to clone 0b2e8a9d-d03a-418c-93c0-02c1b23d4703 from image 83677f79-26f5-43d3-912a-8524a58b7415 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8423c91-f952-4d87-9a6d-a08e223a444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c778ac1-eb0b-464f-bef3-44bedfef1590', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3dbb82-9e39-42ec-9c01-4af2a1c6a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Volume volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 (3c778ac1-eb0b-464f-bef3-44bedfef1590): created successfully Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3dbb82-9e39-42ec-9c01-4af2a1c6a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (35b2a99b-1673-4151-b237-9209e5a53687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c1c49460-fb6f-41a4-aeb7-6715d2f76ba5 tempest-CreateVolumesFromImageTest-1222082838 None] Created volume successfully. Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Flow 'volume_create_manager' (9334da02-b7c9-44f8-9098-5f69c4b5c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8534ea4-a42b-42cd-88e8-aa86195247ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:35:41 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8534ea4-a42b-42cd-88e8-aa86195247ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74177a8d-cc8e-4099-ac64-e57d7bfa835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577750d41844515ba16c0d2580ff312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='c97af9694caa492590487914cdde19ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572939b5-37fc-49e8-b269-49a1a1b7d712),volume_type_id=572939b5-37fc-49e8-b269-49a1a1b7d712)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57efcf-5693-4d58-a294-d8455c504432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57efcf-5693-4d58-a294-d8455c504432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eea0fb-65a8-45a9-9eaa-b7d755a1ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:41 devstack cinder-volume[88466]: DEBUG cinder.image.glance [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Creating Keystone auth plugin from conf {{(pid=88466) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (64eecc04-6926-4dcc-ae88-cebeca39c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f82c9a-7efa-4eda-b999-14537186dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f9595-e775-49dc-98c5-9eea4701cbff]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f82c9a-7efa-4eda-b999-14537186dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556724057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc18f75-2be4-4cb0-b923-a77416bada17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30807fa6-ebec-403a-a74d-f5d3bd46c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30807fa6-ebec-403a-a74d-f5d3bd46c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78aa270-f76b-4804-a581-32a94829fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78aa270-f76b-4804-a581-32a94829fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc18f75-2be4-4cb0-b923-a77416bada17', 'volume_name': 'volume-9cc18f75-2be4-4cb0-b923-a77416bada17', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3789f3e6-1390-4834-990d-74e1547b7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3789f3e6-1390-4834-990d-74e1547b7340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f571ad5-06da-47bf-b309-1f30af4fd48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume 9cc18f75-2be4-4cb0-b923-a77416bada17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc18f75-2be4-4cb0-b923-a77416bada17', 'volume_size': 1} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (c124dfcb-5faf-4c61-bcfa-8f84e68149b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d242832-f04d-4a1d-9f5c-fa637e502574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d242832-f04d-4a1d-9f5c-fa637e502574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479616113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14234b79-113d-4f2b-a7f3-edf1e3c37380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835fd436-c09d-4e34-bbee-737085fd76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835fd436-c09d-4e34-bbee-737085fd76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:42 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596135a6-c5c7-4033-8712-65dad64df68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596135a6-c5c7-4033-8712-65dad64df68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14234b79-113d-4f2b-a7f3-edf1e3c37380', 'volume_name': 'volume-14234b79-113d-4f2b-a7f3-edf1e3c37380', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d217d7-7878-424a-b05d-2631997defe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d217d7-7878-424a-b05d-2631997defe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e35a14-e1d8-4c09-bcdd-838c4680bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume 14234b79-113d-4f2b-a7f3-edf1e3c37380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14234b79-113d-4f2b-a7f3-edf1e3c37380', 'volume_size': 1} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eea0fb-65a8-45a9-9eaa-b7d755a1ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74177a8d-cc8e-4099-ac64-e57d7bfa835a', 'volume_name': 'volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a', 'volume_size': 1, 'image_id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9175641165bd3e827aad744acd8af2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0577750d41844515ba16c0d2580ff312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '384c2c45aeb3ae558c18322196691145a9002d8e4a5349fcf920fc1ec72ea5af17b1c9a2c2cb021752d37ab628c66aee6f8a25447e53a5c0f3ba5ef3d667115e', 'id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e5626-e35f-4eab-a701-a1d6780a5e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e5626-e35f-4eab-a701-a1d6780a5e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5b2d3-6b42-4822-b9e4-7eee209de8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a', 'volume_size': 1, 'image_id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9175641165bd3e827aad744acd8af2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0577750d41844515ba16c0d2580ff312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '384c2c45aeb3ae558c18322196691145a9002d8e4a5349fcf920fc1ec72ea5af17b1c9a2c2cb021752d37ab628c66aee6f8a25447e53a5c0f3ba5ef3d667115e', 'id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Trying to clone 74177a8d-cc8e-4099-ac64-e57d7bfa835a from image b69d43e7-9c3d-4f1b-8e69-39895ebde450 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}]). {{(pid=88466) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:35:42 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd 1073741824" returned: 0 in 0.694s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd Jul 23 03:35:42 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a316b2-60d3-45df-aac8-b2db570f3126]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:42 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:42 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" returned: 0 in 0.311s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.126s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-421396036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd0b802-8339-4646-adfd-b778932758b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595fd44051454fb48897894c6676ab37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:38Z,use_quota=True,user_id='f3143f132dda436fbb9edcf0f79588f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Creating volume 8bd0b802-8339-4646-adfd-b778932758b9 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44f282a-bc72-4ef6-a52a-051a9b0032c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 1073741824 Jul 23 03:35:42 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a090c18-87d5-4a39-95ee-6dec4f1218cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Volume volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd (97f85050-8aed-49d9-8de2-2b4eb0fe74dd): created successfully Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a090c18-87d5-4a39-95ee-6dec4f1218cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (7978bc2b-1ee1-40c3-a829-5387501c5560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4cdd011b-25f6-462c-978b-f41758b20f27 tempest-CreateVolumesFromImageTest-1222082838 None] Created volume successfully. Jul 23 03:35:42 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Temporary image 83677f79-26f5-43d3-912a-8524a58b7415 is fetched for user e778588e23e34e1297aed2a5a06a5bb0. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3c8c3d-520e-488b-a6e7-ecaf337a19a0]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:43 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:43 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 1073741824" returned: 0 in 0.538s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Temporary image b69d43e7-9c3d-4f1b-8e69-39895ebde450 is fetched for user c97af9694caa492590487914cdde19ab. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:35:43 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 Jul 23 03:35:43 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef84ac-dda0-476a-8321-c9d123bce741]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:43 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:43 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9" returned: 0 in 0.324s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762948965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b63e74-d9d5-4a48-a36b-074eae08b454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume 51b63e74-d9d5-4a48-a36b-074eae08b454 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:43 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424a352b-bf0b-4b11-bfd0-69ea61c98b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd0b802-8339-4646-adfd-b778932758b9', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1adbe9-a27b-48db-97f3-76c7844aea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:43 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Volume volume-8bd0b802-8339-4646-adfd-b778932758b9 (8bd0b802-8339-4646-adfd-b778932758b9): created successfully Jul 23 03:35:43 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 1073741824 Jul 23 03:35:43 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1adbe9-a27b-48db-97f3-76c7844aea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Flow 'volume_create_manager' (81a4adcf-c026-43b3-b470-fcbbc9ec2f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:43 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-57a94278-0672-42c1-8027-5f2754120a93 tempest-CreateVolumesFromImageTest-1222082838 None] Created volume successfully. Jul 23 03:35:43 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:43 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-8bd0b802-8339-4646-adfd-b778932758b9-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-8bd0b802-8339-4646-adfd-b778932758b9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-quobyte-8bd0b802-8339-4646-adfd-b778932758b9" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-8bd0b802-8339-4646-adfd-b778932758b9" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2519e2-1f5f-401e-bed0-3c37dda65a26]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:44 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 Jul 23 03:35:44 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 1073741824" returned: 0 in 0.589s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:44 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 Jul 23 03:35:44 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9" returned: 0 in 0.399s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9 Jul 23 03:35:44 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.325s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712754812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd7197-84b8-49d0-8d27-6abf5d8bd67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume 50dd7197-84b8-49d0-8d27-6abf5d8bd67c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:44 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c 1073741824 Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b7c454-2882-4411-b86c-045ee8d80483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b63e74-d9d5-4a48-a36b-074eae08b454', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:44 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928f0c4d-b98a-4bef-a4a6-b5a2300585bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:44 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-51b63e74-d9d5-4a48-a36b-074eae08b454 (51b63e74-d9d5-4a48-a36b-074eae08b454): created successfully Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928f0c4d-b98a-4bef-a4a6-b5a2300585bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (7fe8fb98-ce82-464f-8bcc-727d26c93793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-48109ffc-7acc-42cf-ba30-152ec401d1b4 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:44 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-8bd0b802-8339-4646-adfd-b778932758b9" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-8bd0b802-8339-4646-adfd-b778932758b9" released by "delete_volume" :: held 0.709s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Created reservations ['7e838876-7cb2-49d5-8607-dd161de4d1ac', '0dfc5194-be9d-40c9-b3dc-bbadb43fdaf3', '5e100a7b-63e9-4278-aae2-736cfafb02e5', '352f7e91-a669-490b-84fc-98ecccad195b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:44 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c 1073741824" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-97f85050-8aed-49d9-8de2-2b4eb0fe74dd-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:45 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c Jul 23 03:35:45 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-97f85050-8aed-49d9-8de2-2b4eb0fe74dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:45 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.289s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Deleted volume successfully. Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-quobyte-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-de0b0318-760d-430a-a7bb-13f32374f43a tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-8bd0b802-8339-4646-adfd-b778932758b9-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[262fba57-8b20-4b3c-9c45-3142fefc3410]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd Jul 23 03:35:45 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.020s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673605385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af06dc33-aa2a-45b5-b1a0-67f8cb083d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:41Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume af06dc33-aa2a-45b5-b1a0-67f8cb083d0c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:45 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f396ff8e-2f34-434a-9bd6-8f20ad2bc56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:45 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c 1073741824 Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f7f5e-7eea-4db9-a0df-16b9ce1ff6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:45 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c (50dd7197-84b8-49d0-8d27-6abf5d8bd67c): created successfully Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f7f5e-7eea-4db9-a0df-16b9ce1ff6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (c7b41370-d54e-4139-8fda-4fd523327b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-235adf88-8525-4e3b-9636-6a0adfed589b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:45 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" returned: 0 in 0.376s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd Jul 23 03:35:45 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c 1073741824" returned: 0 in 0.505s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-97f85050-8aed-49d9-8de2-2b4eb0fe74dd" released by "delete_volume" :: held 0.683s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c Jul 23 03:35:45 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Created reservations ['1cd6caa5-c31d-4ece-a4e6-b12a83fc7842', '72f44f48-2ace-4716-8e20-40028e4fa40d', '5798de4a-cd47-49dc-bef4-3313c5d5ed31', '04643038-56be-4987-bf46-b891469fe53f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:46 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556724057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc18f75-2be4-4cb0-b923-a77416bada17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume 9cc18f75-2be4-4cb0-b923-a77416bada17 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0258c48d-99ea-44e6-adec-3181f5dc5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:46 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 1073741824 Jul 23 03:35:46 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e454f2fe-a305-43c1-9f13-e50c4533a14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c (af06dc33-aa2a-45b5-b1a0-67f8cb083d0c): created successfully Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e454f2fe-a305-43c1-9f13-e50c4533a14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (089c9203-298b-41f0-8749-ca9360ee1707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-830a2331-f8ad-4234-9dd0-36191df7b20a tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:46 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:46 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Deleted volume successfully. Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-3c778ac1-eb0b-464f-bef3-44bedfef1590-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5de983d-de2f-4d1b-b5c1-9e6b44273377 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-97f85050-8aed-49d9-8de2-2b4eb0fe74dd-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-3c778ac1-eb0b-464f-bef3-44bedfef1590-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-quobyte-3c778ac1-eb0b-464f-bef3-44bedfef1590" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-3c778ac1-eb0b-464f-bef3-44bedfef1590" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f8688a-9872-4ff3-b403-3621d68d0ad2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 Jul 23 03:35:46 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 1073741824" returned: 0 in 0.487s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 Jul 23 03:35:46 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590" returned: 0 in 0.412s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590 Jul 23 03:35:46 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.678s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479616113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14234b79-113d-4f2b-a7f3-edf1e3c37380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d5874c098c439baf1c936b0b43a859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='b371402259ae43fa84d2b8d6167808e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Creating volume 14234b79-113d-4f2b-a7f3-edf1e3c37380 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f571ad5-06da-47bf-b309-1f30af4fd48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc18f75-2be4-4cb0-b923-a77416bada17', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:47 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 1073741824 Jul 23 03:35:47 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afb2d65-4395-4404-8770-05a07242e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-9cc18f75-2be4-4cb0-b923-a77416bada17 (9cc18f75-2be4-4cb0-b923-a77416bada17): created successfully Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afb2d65-4395-4404-8770-05a07242e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (64eecc04-6926-4dcc-ae88-cebeca39c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-48f48d06-4b20-41a6-bd16-b770e5a31792 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:47 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3c778ac1-eb0b-464f-bef3-44bedfef1590" returned: 0 in 0.272s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-3c778ac1-eb0b-464f-bef3-44bedfef1590" released by "delete_volume" :: held 0.729s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Created reservations ['91b3ce0e-4856-44b0-8516-8dafb4fe548c', '2e7d86f1-a6dc-4e31-8ebc-e13574794492', '53675c74-fffe-47a8-8bae-1a072746a1d6', '39bd790c-2d53-46cf-b6c4-d1fe80d12d0c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:47 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 1073741824" returned: 0 in 0.455s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 Jul 23 03:35:47 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-2c1c95be-25bb-45f2-9cfd-97fe8c02b282-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:47 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Deleted volume successfully. Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-2c1c95be-25bb-45f2-9cfd-97fe8c02b282-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4edeb0c6-2330-482a-80b6-b2aff52725b1 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-3c778ac1-eb0b-464f-bef3-44bedfef1590-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-quobyte-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40d1e75-0c0a-425b-881b-355326baa8f2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380" returned: 0 in 0.328s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.990s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e8a9d-d03a-418c-93c0-02c1b23d4703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca751e9addd40789c3da424d673bf4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:40Z,use_quota=True,user_id='e778588e23e34e1297aed2a5a06a5bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Creating volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:47 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:47 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:47 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 Jul 23 03:35:47 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1073741824 Jul 23 03:35:47 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e35a14-e1d8-4c09-bcdd-838c4680bd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14234b79-113d-4f2b-a7f3-edf1e3c37380', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125e7181-79e9-43ec-bf15-b83146ea39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Volume volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 (14234b79-113d-4f2b-a7f3-edf1e3c37380): created successfully Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125e7181-79e9-43ec-bf15-b83146ea39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Flow 'volume_create_manager' (c124dfcb-5faf-4c61-bcfa-8f84e68149b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:48 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3a96bf5d-dc00-4bf1-9931-72ac70641021 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created volume successfully. Jul 23 03:35:48 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.296s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:35:48 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" returned: 0 in 0.545s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282 Jul 23 03:35:48 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1073741824" returned: 0 in 0.527s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 Jul 23 03:35:48 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" returned: 0 in 0.258s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-2c1c95be-25bb-45f2-9cfd-97fe8c02b282" released by "delete_volume" :: held 0.877s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Created reservations ['b1ea451e-18f7-4743-8cc8-c5dc7c7e391b', 'e0d845c9-8128-471a-84e1-6ee020b57f73', '4c5d4b07-aea0-4501-b745-157d520ee2d3', '0d60195a-ac3e-4347-b1d1-3f0f857d91d3'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.337s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74177a8d-cc8e-4099-ac64-e57d7bfa835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577750d41844515ba16c0d2580ff312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:42Z,use_quota=True,user_id='c97af9694caa492590487914cdde19ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572939b5-37fc-49e8-b269-49a1a1b7d712),volume_type_id=572939b5-37fc-49e8-b269-49a1a1b7d712)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Creating volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:48 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:48 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:48 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1073741824 Jul 23 03:35:48 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Attempting download of 83677f79-26f5-43d3-912a-8524a58b7415 ((None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}])) to volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-6b328e0f-d373-4f4d-b9aa-94706121583b-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-6b328e0f-d373-4f4d-b9aa-94706121583b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e098a-bd93-4d3a-8bdf-b3bad68e74ac]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "cinder-quobyte-6b328e0f-d373-4f4d-b9aa-94706121583b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-6b328e0f-d373-4f4d-b9aa-94706121583b" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:48 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.347s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229d6f1-f53e-47f5-bf3f-266db29277e8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Deleted volume successfully. Jul 23 03:35:49 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez Jul 23 03:35:49 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-14234b79-113d-4f2b-a7f3-edf1e3c37380-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:49 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b Jul 23 03:35:49 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a0f0df6-31fc-4f97-98e4-ea43f2819abf tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-2c1c95be-25bb-45f2-9cfd-97fe8c02b282-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-14234b79-113d-4f2b-a7f3-edf1e3c37380-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-14234b79-113d-4f2b-a7f3-edf1e3c37380" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-14234b79-113d-4f2b-a7f3-edf1e3c37380" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ceca08-7f16-45b5-b5e4-e3e25ac173ac]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez" returned: 0 in 0.510s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1073741824" returned: 0 in 0.735s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 Jul 23 03:35:49 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a Jul 23 03:35:49 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez Jul 23 03:35:49 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b" returned: 0 in 0.545s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b Jul 23 03:35:49 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez" returned: 1 in 0.369s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83677f79-26f5-43d3-912a-8524a58b7415_4e31qxez' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d2e27-6bd7-4a1f-aece-7cab636741b2]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380" returned: 0 in 0.523s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Attempting download of b69d43e7-9c3d-4f1b-8e69-39895ebde450 ((None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}])) to volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:35:49 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380 Jul 23 03:35:49 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6b328e0f-d373-4f4d-b9aa-94706121583b" returned: 0 in 0.299s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:49 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:49 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-quobyte-6b328e0f-d373-4f4d-b9aa-94706121583b" released by "delete_volume" :: held 0.935s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f33461-87c6-4172-a03c-89e9df95c83a]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Created reservations ['35512ded-d4a2-482e-ae2b-6f2df16d4dff', '9fbe2bd8-d493-479f-9f1e-177fe16a9806', '6bf88442-382e-445d-81b7-0a79312df6d3', 'cb172c65-ed97-4b4c-a3f0-371a0b3fed0a'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:50 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl Jul 23 03:35:50 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:50 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-14234b79-113d-4f2b-a7f3-edf1e3c37380" returned: 0 in 0.319s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-14234b79-113d-4f2b-a7f3-edf1e3c37380" released by "delete_volume" :: held 0.916s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:50 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD Jul 23 03:35:50 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['cb7da846-bc7b-4b58-95ab-71f47c0184c7', 'b9aee942-45bd-431a-83b7-53e36284f757', '51489bec-0102-4f81-b56b-6c97faeb0ced', '4d7b8ded-20db-4c1c-9ff5-88377a5a0e0d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:50 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl" returned: 0 in 0.443s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:50 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Deleted volume successfully. Jul 23 03:35:50 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl Jul 23 03:35:50 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7a7d432-a9e5-45fe-b38e-3e718c654745 tempest-CreateVolumesFromImageTest-1222082838 None] Lock "cinder-6b328e0f-d373-4f4d-b9aa-94706121583b-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:50 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] 83677f79-26f5-43d3-912a-8524a58b7415 was raw, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-9cc18f75-2be4-4cb0-b923-a77416bada17-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:50 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 Jul 23 03:35:50 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-9cc18f75-2be4-4cb0-b923-a77416bada17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-9cc18f75-2be4-4cb0-b923-a77416bada17" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-9cc18f75-2be4-4cb0-b923-a77416bada17" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f1b195-b670-4a00-ae6f-8f1c695a4462]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b2ee70de-1ef4-48b9-b1dc-1ae3b2f725b3 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-14234b79-113d-4f2b-a7f3-edf1e3c37380-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:50 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl" returned: 1 in 0.561s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69d43e7-9c3d-4f1b-8e69-39895ebde450_qbhbptrl' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c6700e-33d3-406f-8a07-198267b8c935]: (4, 'raw') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 Jul 23 03:35:50 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:51 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" returned: 0 in 0.560s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83677f79-26f5-43d3-912a-8524a58b7415__52rfysgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:35:51 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1G Jul 23 03:35:51 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17" returned: 0 in 0.495s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17 Jul 23 03:35:51 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD Jul 23 03:35:51 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9cc18f75-2be4-4cb0-b923-a77416bada17" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 1G" returned: 0 in 0.371s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Downloaded image 83677f79-26f5-43d3-912a-8524a58b7415 ((None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}])) to volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703 successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Temporary image 83677f79-26f5-43d3-912a-8524a58b7415 for user e778588e23e34e1297aed2a5a06a5bb0 is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Marking volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703 as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-9cc18f75-2be4-4cb0-b923-a77416bada17" released by "delete_volume" :: held 0.824s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Copying metadata from image 83677f79-26f5-43d3-912a-8524a58b7415 to 0b2e8a9d-d03a-418c-93c0-02c1b23d4703. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Creating volume glance metadata for volume 0b2e8a9d-d03a-418c-93c0-02c1b23d4703 backed by image 83677f79-26f5-43d3-912a-8524a58b7415 with: {'image_id': '83677f79-26f5-43d3-912a-8524a58b7415', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7f0c7f327d28c5c237269b5c5dfe236c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['0f6d3f52-489e-4ae7-a4ce-82afa91e23dc', '7c55fd04-0852-465e-a548-d92d521b7f0e', '92cfd5aa-8d47-4e58-ad11-15e2169e6812', 'c50222e7-9d3f-47ba-8f1a-674de37ee4de'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:51 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] b69d43e7-9c3d-4f1b-8e69-39895ebde450 was raw, converting to qcow2 {{(pid=88466) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a Jul 23 03:35:51 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb65b0fa-4202-4bdb-afcd-b172d01a3217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703', 'volume_size': 1, 'image_id': '83677f79-26f5-43d3-912a-8524a58b7415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83677f79-26f5-43d3-912a-8524a58b7415', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f0c7f327d28c5c237269b5c5dfe236c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ca751e9addd40789c3da424d673bf4d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e1b450d6d09f8e63da003302b83207d01b137b74462704ef21d3f6e1b30ac3f602ffe5df3c75b622c7ead7a997f322f1be3029c8da8021bc07471fb67108e90', 'id': '83677f79-26f5-43d3-912a-8524a58b7415', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83677f79-26f5-43d3-912a-8524a58b7415/file', 'properties': {}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6695774-0f9a-48f8-9c88-72ed2ed1ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:51 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Volume volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 (0b2e8a9d-d03a-418c-93c0-02c1b23d4703): created successfully Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6695774-0f9a-48f8-9c88-72ed2ed1ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Flow 'volume_create_manager' (623dcf52-4d40-4326-9fe4-f6abb4bafaea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7d49d53c-099f-4be4-aaee-beb6bf645725 tempest-VolumeImageDependencyTests-1521618564 None] Created volume successfully. Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:51 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:51 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" acquired by "delete_volume" :: waited 0.044s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1e6745-ae0e-4571-bc32-4713bd71195a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.376s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6dff15aa-35c2-4b3d-8762-9f51b9dcbef6 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-9cc18f75-2be4-4cb0-b923-a77416bada17-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:52 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c Jul 23 03:35:52 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:52 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a" returned: 0 in 0.791s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69d43e7-9c3d-4f1b-8e69-39895ebde450_to70_c8bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:35:52 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:52 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1G Jul 23 03:35:52 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Acquiring lock "cinder-0b2e8a9d-d03a-418c-93c0-02c1b23d4703-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "cinder-0b2e8a9d-d03a-418c-93c0-02c1b23d4703-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Acquiring lock "cinder-quobyte-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:52 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" returned: 0 in 0.627s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "cinder-quobyte-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" acquired by "delete_volume" :: waited 0.043s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:52 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c Jul 23 03:35:52 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[211fde40-5e5a-40d0-aebb-61e81ad8cb12]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:52 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 Jul 23 03:35:52 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:53 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a 1G" returned: 0 in 0.498s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Downloaded image b69d43e7-9c3d-4f1b-8e69-39895ebde450 ((None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}])) to volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a successfully. {{(pid=88466) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Temporary image b69d43e7-9c3d-4f1b-8e69-39895ebde450 for user c97af9694caa492590487914cdde19ab is deleted. {{(pid=88466) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.volume_utils [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Marking volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a as bootable. {{(pid=88466) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Copying metadata from image b69d43e7-9c3d-4f1b-8e69-39895ebde450 to 74177a8d-cc8e-4099-ac64-e57d7bfa835a. {{(pid=88466) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Creating volume glance metadata for volume 74177a8d-cc8e-4099-ac64-e57d7bfa835a backed by image b69d43e7-9c3d-4f1b-8e69-39895ebde450 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd9175641165bd3e827aad744acd8af2e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88466) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:35:53 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" returned: 0 in 0.391s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c" released by "delete_volume" :: held 1.075s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5b2d3-6b42-4822-b9e4-7eee209de8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a', 'volume_size': 1, 'image_id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9175641165bd3e827aad744acd8af2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0577750d41844515ba16c0d2580ff312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '384c2c45aeb3ae558c18322196691145a9002d8e4a5349fcf920fc1ec72ea5af17b1c9a2c2cb021752d37ab628c66aee6f8a25447e53a5c0f3ba5ef3d667115e', 'id': 'b69d43e7-9c3d-4f1b-8e69-39895ebde450', 'created_at': datetime.datetime(2026, 7, 23, 1, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 35, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69d43e7-9c3d-4f1b-8e69-39895ebde450/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f21d2e-81e1-402b-96c3-d024910a63bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:53 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Volume volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a (74177a8d-cc8e-4099-ac64-e57d7bfa835a): created successfully Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f21d2e-81e1-402b-96c3-d024910a63bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Flow 'volume_create_manager' (9334da02-b7c9-44f8-9098-5f69c4b5c325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-14b034d2-f2e1-4bbb-a4a8-35168aadc454 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Created volume successfully. Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['82aa53ad-a188-4dbf-848f-8f2a8a056727', 'f86ed18a-40f2-4b1b-963d-96f1828de551', '1a4604ef-7555-4e0c-9e91-8ac71dcc3f70', 'fcf00fb1-202f-424b-8747-e431bdb02f66'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:53 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" returned: 0 in 0.517s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:53 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:53 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:53 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703 Jul 23 03:35:53 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:53 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d636797c-7260-4f8a-8589-bc889b493f6d tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-af06dc33-aa2a-45b5-b1a0-67f8cb083d0c-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:53 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" returned: 0 in 0.334s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Acquiring lock "cinder-74177a8d-cc8e-4099-ac64-e57d7bfa835a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "cinder-quobyte-0b2e8a9d-d03a-418c-93c0-02c1b23d4703" released by "delete_volume" :: held 0.920s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "cinder-74177a8d-cc8e-4099-ac64-e57d7bfa835a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Acquiring lock "cinder-quobyte-74177a8d-cc8e-4099-ac64-e57d7bfa835a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Created reservations ['4242ec12-da86-406b-8639-aee2b2502f8c', '82379073-10ef-4adb-badf-bd7b110bbe08', 'd4d305ea-91bc-4f7c-92e8-4ea0935a575d', '000dc16a-439b-4cfd-8bb3-eddb132bb458'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "cinder-quobyte-74177a8d-cc8e-4099-ac64-e57d7bfa835a" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5528ad4-0c4f-43ac-b74b-c2cc63d567f5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:53 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:53 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:53 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a Jul 23 03:35:53 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.309s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-50dd7197-84b8-49d0-8d27-6abf5d8bd67c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Deleted volume successfully. Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-50dd7197-84b8-49d0-8d27-6abf5d8bd67c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-4772c335-ccc7-4cb2-8711-1fb57a083447 tempest-VolumeImageDependencyTests-1521618564 None] Lock "cinder-0b2e8a9d-d03a-418c-93c0-02c1b23d4703-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:54 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a" returned: 0 in 0.462s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:54 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a Jul 23 03:35:54 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0101a-f625-40b4-ba5d-6bd9630b8084]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c Jul 23 03:35:54 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-74177a8d-cc8e-4099-ac64-e57d7bfa835a" returned: 0 in 0.299s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "cinder-quobyte-74177a8d-cc8e-4099-ac64-e57d7bfa835a" released by "delete_volume" :: held 0.813s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Created reservations ['9afe552e-119e-48fd-8fd0-75a8cc2fbbbe', '01fd970d-e9c3-406c-956b-d55d45b1b705', '3db4876d-3b26-4a64-b8b1-e4f34376857d', 'd1eacc60-470a-4e27-ba9e-7f467c38f2e4'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:54 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" returned: 0 in 0.530s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c Jul 23 03:35:54 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:55 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Deleted volume successfully. Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-89e058a0-ff0f-431e-a61f-a130ce632ee4 tempest-VolumeAndVolumeTypeFromImageTest-424122895 None] Lock "cinder-74177a8d-cc8e-4099-ac64-e57d7bfa835a-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:55 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (0b920e6c-92de-421d-8f8c-50b21cd6d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a630b0cf-1a3a-44dc-97ad-9b9c171dd16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-50dd7197-84b8-49d0-8d27-6abf5d8bd67c" released by "delete_volume" :: held 0.957s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a630b0cf-1a3a-44dc-97ad-9b9c171dd16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641956243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7d27d6-d9e2-4357-bf62-17bf6dd97234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:55Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6432261-9a59-4171-b8c1-e5d340099635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6432261-9a59-4171-b8c1-e5d340099635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e044d597-32e8-441e-9567-c0c4e54847d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e044d597-32e8-441e-9567-c0c4e54847d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7d27d6-d9e2-4357-bf62-17bf6dd97234', 'volume_name': 'volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c30c13-e42c-4c9a-aaac-0a00f3b80cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c30c13-e42c-4c9a-aaac-0a00f3b80cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d30c500-e414-46ad-9c8d-5cafbea323b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume 3b7d27d6-d9e2-4357-bf62-17bf6dd97234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234', 'volume_size': 1} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641956243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7d27d6-d9e2-4357-bf62-17bf6dd97234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:55Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume 3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:55 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:55 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 1073741824 Jul 23 03:35:55 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['e2b1e242-3c7f-450f-84f7-6d298f59411f', '4427f7ab-bcc9-4129-95dd-09d7e5c65fb5', '88aa45b7-8456-4919-ac90-ea16ae4a03cf', '8c97d452-6126-4a89-bf74-f2462e6ac13d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:55 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:55 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:55 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:35:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ea7091f6-bc97-4660-8ccd-8eb9f4079279 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-50dd7197-84b8-49d0-8d27-6abf5d8bd67c-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:56 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 1073741824" returned: 0 in 0.669s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:56 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 Jul 23 03:35:56 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" returned: 0 in 0.300s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d30c500-e414-46ad-9c8d-5cafbea323b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41c3f7-4915-44b2-b503-be5765625e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 (3b7d27d6-d9e2-4357-bf62-17bf6dd97234): created successfully Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41c3f7-4915-44b2-b503-be5765625e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (0b920e6c-92de-421d-8f8c-50b21cd6d069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-581db9ce-32dc-428d-94d9-9a953e4ce2ee tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-51b63e74-d9d5-4a48-a36b-074eae08b454-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-51b63e74-d9d5-4a48-a36b-074eae08b454-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-51b63e74-d9d5-4a48-a36b-074eae08b454" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-51b63e74-d9d5-4a48-a36b-074eae08b454" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c93d4b-c7e7-45f7-b365-6b7746c2c99a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:56 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 Jul 23 03:35:56 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:57 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454" returned: 0 in 0.528s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:57 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454 Jul 23 03:35:57 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:57 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-51b63e74-d9d5-4a48-a36b-074eae08b454" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-51b63e74-d9d5-4a48-a36b-074eae08b454" released by "delete_volume" :: held 0.948s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating offline snapshot e7e45d11-396c-4706-89e3-5cb13e846779 of volume 3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['7f48f83b-370a-4e2e-9b00-a85b9689f0d1', '74949203-0e1d-4ce4-b8dc-64bb630bb58e', 'fcfd239b-0fc2-4cdf-a3b8-eb6d22f351ce', '26fd4f29-3188-422f-9a82-4237e3bfb5f4'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b3717-275d-4201-9585-b6d57653e44a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:57 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 Jul 23 03:35:57 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:57 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:35:57 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:58 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.305s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:35:58 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e634ce91-f7bd-4781-aff3-467b92044d41 tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-51b63e74-d9d5-4a48-a36b-074eae08b454-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" returned: 0 in 0.503s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:58 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 1G Jul 23 03:35:58 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:58 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 1G" returned: 0 in 0.581s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:58 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 Jul 23 03:35:58 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "cinder-quobyte-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e3248-2dd8-4a57-9b82-4d817c4eb9a0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:59 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 Jul 23 03:35:59 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:59 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779" returned: 0 in 0.452s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:59 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 is being set with open permissions: ugo+rw Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:59 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 Jul 23 03:35:59 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:59 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" returned: 0 in 0.469s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:59 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0 Jul 23 03:35:59 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:59 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779" returned: 0 in 0.321s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:59 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info Jul 23 03:35:59 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:59 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-quobyte-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0" released by "delete_volume" :: held 0.851s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:59 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Created reservations ['4a829632-1594-4ce5-b753-054814da750c', '3961e14c-7116-4216-a020-50069e929a46', '5154c882-5c27-4ecf-9e2e-fadfa8fd9642', '1c094d5a-c255-45e6-9ef4-1b3e32e46bbf'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:00 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info" returned: 0 in 0.359s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info is being set with open permissions: ugo+rw Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:00 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info Jul 23 03:36:00 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:00 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:00 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:00 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.info" returned: 0 in 0.369s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:00 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Deleted volume successfully. Jul 23 03:36:00 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e2f3138c-ddca-4f28-a0ac-a2941fc6ece5 tempest-CreateVolumesFromSnapshotTest-626845001 None] Create snapshot completed successfully Jul 23 03:36:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d9af658a-003e-4b73-8f95-a7206dc9930b tempest-CreateVolumesFromSourceVolumeTest-1137619478 None] Lock "cinder-060c2a76-4ec4-4c2c-a2e4-02a10b199ca0-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (a397561f-b6b0-469e-a4f5-5c6b214f4606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57dd83-8999-41b7-a591-b0ac6056b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57dd83-8999-41b7-a591-b0ac6056b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819082714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecc2a29-6973-42af-8299-1855aa2e305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:01Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3276b4a-cd5d-4db2-a074-2ac3e50cca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3276b4a-cd5d-4db2-a074-2ac3e50cca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad969b-b9f9-4801-a97b-8a2dc5865e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad969b-b9f9-4801-a97b-8a2dc5865e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fecc2a29-6973-42af-8299-1855aa2e305c', 'volume_name': 'volume-fecc2a29-6973-42af-8299-1855aa2e305c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fb65d7-92b6-4bfd-b348-db2113380e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fb65d7-92b6-4bfd-b348-db2113380e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d391b2b0-5847-4c2e-9e13-1e82637b0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume fecc2a29-6973-42af-8299-1855aa2e305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fecc2a29-6973-42af-8299-1855aa2e305c', 'volume_size': 1} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1819082714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecc2a29-6973-42af-8299-1855aa2e305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:01Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume fecc2a29-6973-42af-8299-1855aa2e305c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:01 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:01 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c 1073741824 Jul 23 03:36:01 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (694097e4-0c09-4c69-9a06-89bdc26ac2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094235a7-7e0a-4dba-9937-9d75c73def11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094235a7-7e0a-4dba-9937-9d75c73def11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660379125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c77fff0-92bc-449c-9be0-79af4a8f101e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:02Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94509a9-953e-4158-a916-fef8bc377965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94509a9-953e-4158-a916-fef8bc377965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc73f30-2fbb-4bc0-aee0-c2d53f5cd2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc73f30-2fbb-4bc0-aee0-c2d53f5cd2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c77fff0-92bc-449c-9be0-79af4a8f101e', 'volume_name': 'volume-1c77fff0-92bc-449c-9be0-79af4a8f101e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1688e47-09ed-4ac7-88e0-60b95e5291eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1688e47-09ed-4ac7-88e0-60b95e5291eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5823c61-47dd-4dec-862b-ebd7f2f865e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume 1c77fff0-92bc-449c-9be0-79af4a8f101e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c77fff0-92bc-449c-9be0-79af4a8f101e', 'volume_size': 1} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:02 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (ac1c1f78-0cdf-4536-9722-ea1c5bd21b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0537e69-06e2-4561-aa66-60fdfde476de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c 1073741824" returned: 0 in 0.823s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0537e69-06e2-4561-aa66-60fdfde476de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591570069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c018239d-8ff2-4149-bb6c-8e2bde7b83ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:02Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a81a4d-9356-4210-bb52-ba2936400286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a81a4d-9356-4210-bb52-ba2936400286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28df605-71da-47d4-b3c6-f9d4ab812812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28df605-71da-47d4-b3c6-f9d4ab812812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c018239d-8ff2-4149-bb6c-8e2bde7b83ab', 'volume_name': 'volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df292ee-3d52-4a57-a47c-11d291b7e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df292ee-3d52-4a57-a47c-11d291b7e87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af0bcc-019a-4ef9-acfa-14051dba2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Volume c018239d-8ff2-4149-bb6c-8e2bde7b83ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab', 'volume_size': 1} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:02 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c Jul 23 03:36:02 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (48ef945d-ecfd-4b69-bd1a-fd08f18a8322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceca286c-6ffd-4922-bf8f-e5f30943d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceca286c-6ffd-4922-bf8f-e5f30943d751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100255466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23a18ff-fded-471d-b933-87af2e000532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:03Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1393ce-bc65-412f-8281-1f65033c4000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1393ce-bc65-412f-8281-1f65033c4000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391210e6-b447-4f37-a30d-c2c08504afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391210e6-b447-4f37-a30d-c2c08504afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23a18ff-fded-471d-b933-87af2e000532', 'volume_name': 'volume-a23a18ff-fded-471d-b933-87af2e000532', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f85e7e-0236-4012-bc0d-e61f15b2ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f85e7e-0236-4012-bc0d-e61f15b2ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5ad99e-c05d-4d7e-8673-d45e64f65ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:02 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume a23a18ff-fded-471d-b933-87af2e000532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23a18ff-fded-471d-b933-87af2e000532', 'volume_size': 1} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:02 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c" returned: 0 in 0.417s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660379125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c77fff0-92bc-449c-9be0-79af4a8f101e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:02Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume 1c77fff0-92bc-449c-9be0-79af4a8f101e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:03 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d391b2b0-5847-4c2e-9e13-1e82637b0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fecc2a29-6973-42af-8299-1855aa2e305c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e 1073741824 Jul 23 03:36:03 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8fc87-cc82-4217-9225-08a7a36a9f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-fecc2a29-6973-42af-8299-1855aa2e305c (fecc2a29-6973-42af-8299-1855aa2e305c): created successfully Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8fc87-cc82-4217-9225-08a7a36a9f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (a397561f-b6b0-469e-a4f5-5c6b214f4606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a8134a85-e430-4a5f-9000-32984f66807e tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (d4c92e47-0ef5-4f4f-84b1-ea61b4fafcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301624f9-253d-4979-b3bc-015100d6deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301624f9-253d-4979-b3bc-015100d6deca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148752994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f38396-c667-4a08-829c-b9d3280f9047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:03Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38b5fa-83a5-47fb-8742-e0a5250e59bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38b5fa-83a5-47fb-8742-e0a5250e59bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11717e4-d884-4392-8a65-ea695129ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11717e4-d884-4392-8a65-ea695129ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f38396-c667-4a08-829c-b9d3280f9047', 'volume_name': 'volume-18f38396-c667-4a08-829c-b9d3280f9047', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d746b0-eb60-4dda-9194-168c481fa7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d746b0-eb60-4dda-9194-168c481fa7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f523bb95-ba6e-4672-98e0-2b99f729c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume 18f38396-c667-4a08-829c-b9d3280f9047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f38396-c667-4a08-829c-b9d3280f9047', 'volume_size': 1} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:03 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e 1073741824" returned: 0 in 0.795s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:03 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e Jul 23 03:36:03 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (99ae37c6-c7e4-4f9a-81a6-63ed75b6aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a529f86e-705f-402d-aa40-c369fd0e5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a529f86e-705f-402d-aa40-c369fd0e5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13464216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:04Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99c62c1-2ce2-42f0-8911-9e82dbb75d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99c62c1-2ce2-42f0-8911-9e82dbb75d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ca4bd2-3c67-4605-a66a-9cff0600ff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ca4bd2-3c67-4605-a66a-9cff0600ff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa', 'volume_name': 'volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68ff61b-2b80-4b6a-aef3-d6a9cc7f3e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68ff61b-2b80-4b6a-aef3-d6a9cc7f3e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cbcab2-e975-4977-bdec-9531bef6395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume 9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa', 'volume_size': 1} Jul 23 03:36:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:04 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e" returned: 0 in 0.312s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591570069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c018239d-8ff2-4149-bb6c-8e2bde7b83ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:02Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Creating volume c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5823c61-47dd-4dec-862b-ebd7f2f865e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c77fff0-92bc-449c-9be0-79af4a8f101e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:04 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab 1073741824 Jul 23 03:36:04 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbfbf37-5793-4053-9510-322f87d81536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-1c77fff0-92bc-449c-9be0-79af4a8f101e (1c77fff0-92bc-449c-9be0-79af4a8f101e): created successfully Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbfbf37-5793-4053-9510-322f87d81536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (694097e4-0c09-4c69-9a06-89bdc26ac2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0299ba3e-6a2d-4ede-96bb-5901a8190e5c tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:36:04 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab 1073741824" returned: 0 in 0.598s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:04 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab Jul 23 03:36:04 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:05 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2100255466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23a18ff-fded-471d-b933-87af2e000532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:03Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume a23a18ff-fded-471d-b933-87af2e000532 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:05 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15af0bcc-019a-4ef9-acfa-14051dba2c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 1073741824 Jul 23 03:36:05 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035ab9b-f284-4bed-83f2-0a5c3fe0ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Volume volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab (c018239d-8ff2-4149-bb6c-8e2bde7b83ab): created successfully Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035ab9b-f284-4bed-83f2-0a5c3fe0ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (ac1c1f78-0cdf-4536-9722-ea1c5bd21b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-673abf3d-0075-463e-aca7-5678d8440173 tempest-ProjectReaderTests-1489480249 None] Created volume successfully. Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Flow 'volume_create_manager' (867a7646-4a79-4cb9-a156-d5284feb1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1258ab-293e-4b36-a38c-431454555ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1258ab-293e-4b36-a38c-431454555ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1570064168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d0b0cc-f962-4790-8ef2-6e61fd0236ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d2861d660046c19e5bad51fec0e708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:06Z,use_quota=True,user_id='1907d9f5c13446dda50694ef7e7869e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ad0963-5d62-4f39-a38a-e019a4deb8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ad0963-5d62-4f39-a38a-e019a4deb8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e1d987-9ef8-4840-b922-3be8ebe27b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e1d987-9ef8-4840-b922-3be8ebe27b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d0b0cc-f962-4790-8ef2-6e61fd0236ea', 'volume_name': 'volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4ebeba-1251-4e7e-90fa-3e00b2c9cd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4ebeba-1251-4e7e-90fa-3e00b2c9cd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49242511-4aa7-4612-858e-ab26caac04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:05 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Volume d8d0b0cc-f962-4790-8ef2-6e61fd0236ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea', 'volume_size': 1} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:05 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 1073741824" returned: 0 in 0.779s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 Jul 23 03:36:06 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148752994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f38396-c667-4a08-829c-b9d3280f9047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:03Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume 18f38396-c667-4a08-829c-b9d3280f9047 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:06 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5ad99e-c05d-4d7e-8673-d45e64f65ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23a18ff-fded-471d-b933-87af2e000532', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6cc403-40ff-46de-8c83-9839b10e669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 1073741824 Jul 23 03:36:06 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-a23a18ff-fded-471d-b933-87af2e000532 (a23a18ff-fded-471d-b933-87af2e000532): created successfully Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6cc403-40ff-46de-8c83-9839b10e669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (48ef945d-ecfd-4b69-bd1a-fd08f18a8322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-68b82358-a038-42c0-bff1-0d262e17ab06 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:36:06 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 1073741824" returned: 0 in 0.502s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 Jul 23 03:36:06 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13464216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916137bb0a664e3e8ce85d2bd466a1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:04Z,use_quota=True,user_id='0fba1f63078146ac8d8918aea791d5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Creating volume 9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:07 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f523bb95-ba6e-4672-98e0-2b99f729c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f38396-c667-4a08-829c-b9d3280f9047', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:07 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa 1073741824 Jul 23 03:36:07 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676434cb-bbab-401d-99e2-6130e3363ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:07 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-18f38396-c667-4a08-829c-b9d3280f9047 (18f38396-c667-4a08-829c-b9d3280f9047): created successfully Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676434cb-bbab-401d-99e2-6130e3363ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (d4c92e47-0ef5-4f4f-84b1-ea61b4fafcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4170f0d9-4e20-4b69-9308-404d13bf739f tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:36:07 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa 1073741824" returned: 0 in 0.522s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa Jul 23 03:36:07 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" returned: 0 in 0.282s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1570064168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d0b0cc-f962-4790-8ef2-6e61fd0236ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d2861d660046c19e5bad51fec0e708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:06Z,use_quota=True,user_id='1907d9f5c13446dda50694ef7e7869e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Creating volume d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:07 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cbcab2-e975-4977-bdec-9531bef6395f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:07 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea 1073741824 Jul 23 03:36:07 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423b6deb-6853-4f32-ab6a-9ab0f9a23b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Volume volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa (9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa): created successfully Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423b6deb-6853-4f32-ab6a-9ab0f9a23b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Flow 'volume_create_manager' (99ae37c6-c7e4-4f9a-81a6-63ed75b6aa57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f4e7e190-8287-47d1-b52e-91fb5366fb94 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created volume successfully. Jul 23 03:36:08 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea 1073741824" returned: 0 in 0.468s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:08 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:08 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:08 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.248s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.823s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49242511-4aa7-4612-858e-ab26caac04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c850e5-b89c-4b88-b0c3-459308edb8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Creating offline snapshot 959ec1de-ab07-4101-9eeb-417137abcffb of volume c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec66665-c944-4526-9b7b-ed7f066a0b61]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Volume volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea (d8d0b0cc-f962-4790-8ef2-6e61fd0236ea): created successfully Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c850e5-b89c-4b88-b0c3-459308edb8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Flow 'volume_create_manager' (867a7646-4a79-4cb9-a156-d5284feb1425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:08 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-46ef8933-201d-4855-b04a-3ee7d7979c49 tempest-VolumeDependencyTests-609820565 None] Created volume successfully. Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:08 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab Jul 23 03:36:08 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1940e2-b3bb-4003-93a3-89955b002354]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa Jul 23 03:36:09 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" returned: 0 in 0.449s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb 1G Jul 23 03:36:09 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" returned: 0 in 0.434s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa Jul 23 03:36:09 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" returned: 0 in 0.287s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa" released by "delete_volume" :: held 0.787s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:09 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb 1G" returned: 0 in 0.507s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb Jul 23 03:36:09 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['6281b58b-1391-44cf-b52b-8dd342f4144d', 'bf49e232-cd59-4c97-9996-51b09865c4c7', '0e2949c9-16de-438b-8d06-c997c6893f8a', '23bf8932-4e76-4e32-87a1-1c2460ef579f'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:09 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-18f38396-c667-4a08-829c-b9d3280f9047-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:10 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb" returned: 0 in 0.427s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb is being set with open permissions: ugo+rw Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-18f38396-c667-4a08-829c-b9d3280f9047-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:10 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb Jul 23 03:36:10 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-18f38396-c667-4a08-829c-b9d3280f9047" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-18f38396-c667-4a08-829c-b9d3280f9047" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[41400681-ed36-4c27-a6c6-273d1944cbdb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.503s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:10 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5850dbab-58b7-4755-aeb6-66354cef9527 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-9bfe347f-6128-43f1-8ff0-ffb2fb1f36aa-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:10 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 Jul 23 03:36:10 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info Jul 23 03:36:10 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047" returned: 0 in 0.471s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047 Jul 23 03:36:10 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info" returned: 0 in 0.329s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info is being set with open permissions: ugo+rw Jul 23 03:36:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info Jul 23 03:36:10 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-18f38396-c667-4a08-829c-b9d3280f9047" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-18f38396-c667-4a08-829c-b9d3280f9047" released by "delete_volume" :: held 0.851s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:11 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.info" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.764s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Creating offline snapshot 044757e3-2106-45cc-8363-d04ebcac5b6a of volume d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c143eb9c-6446-452d-b577-960a3610218f tempest-ProjectReaderTests-1489480249 None] Create snapshot completed successfully Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[813db341-ab35-4c59-aa39-d65a64ce2b51]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['b8473cac-a8c7-478e-b710-f4e14804b61d', '60d6da91-abc2-417d-b2a9-3eef4f3fc7b2', '5b4d02de-385c-4b31-90e1-222d114784f1', 'b92d8803-e8a7-4dd2-a3d8-1ead7ad153e9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:11 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:11 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.302s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:11 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.461s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a 1G Jul 23 03:36:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f04c58cd-a9eb-4c08-a3ac-b2499f0652a7 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-18f38396-c667-4a08-829c-b9d3280f9047-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:11 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a 1G" returned: 0 in 0.474s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:12 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-959ec1de-ab07-4101-9eeb-417137abcffb-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-959ec1de-ab07-4101-9eeb-417137abcffb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-959ec1de-ab07-4101-9eeb-417137abcffb" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-a23a18ff-fded-471d-b933-87af2e000532-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-959ec1de-ab07-4101-9eeb-417137abcffb" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Deleting offline snapshot 959ec1de-ab07-4101-9eeb-417137abcffb of volume c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] snapshot_file for this snap is: volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8437d9c-3bed-482b-a033-30ee12b5b005]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-a23a18ff-fded-471d-b933-87af2e000532-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a is being set with open permissions: ugo+rw Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:12 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-a23a18ff-fded-471d-b933-87af2e000532" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-a23a18ff-fded-471d-b933-87af2e000532" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a708ae-0297-4be6-8b9b-e4990179151a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb Jul 23 03:36:12 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 Jul 23 03:36:12 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.335s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info Jul 23 03:36:13 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb" returned: 0 in 0.475s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a12fb3-1404-4d7e-9428-20e72deb310e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532" returned: 0 in 0.505s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab Jul 23 03:36:13 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532 Jul 23 03:36:13 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info" returned: 0 in 0.313s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info is being set with open permissions: ugo+rw Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info Jul 23 03:36:13 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a23a18ff-fded-471d-b933-87af2e000532" returned: 0 in 0.331s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-a23a18ff-fded-471d-b933-87af2e000532" released by "delete_volume" :: held 0.901s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:13 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" returned: 0 in 0.519s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.info" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb Jul 23 03:36:13 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:13 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-8ddeb7fd-585c-4176-ba91-27002190be5e tempest-VolumeDependencyTests-609820565 None] Create snapshot completed successfully Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['74a2bb92-a6c5-429b-a0ad-486ad4fb5d8c', '9cc7a4e9-70ee-4916-9cf0-d24f897cd6dd', '015892cf-fff5-4b09-96a3-8e476e6cf6de', 'af563e8f-cc05-4c7c-a39a-c843d55ebc56'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:13 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:14 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb" returned: 0 in 0.406s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:14 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb Jul 23 03:36:14 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:14 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.301s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-282efd75-b2e9-43c3-959d-74ca75017441 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-a23a18ff-fded-471d-b933-87af2e000532-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:14 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab.959ec1de-ab07-4101-9eeb-417137abcffb" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-959ec1de-ab07-4101-9eeb-417137abcffb" released by "_delete_snapshot" :: held 1.800s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" released by "delete_snapshot" :: held 1.866s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Created reservations ['2d02e3d1-a156-45c2-992f-a96aa22c1942', '36a121c1-8515-4b18-a6a9-c8508716f345', '3de364f6-bd1a-4dba-b938-7ac71de26119', 'ae4717d1-64e9-4c7f-bdc9-c0d788fed1d2'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:14 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Delete snapshot completed successfully. Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c0702e6e-194a-42cd-9d54-040e263d7e46 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-959ec1de-ab07-4101-9eeb-417137abcffb-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-c018239d-8ff2-4149-bb6c-8e2bde7b83ab-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c018239d-8ff2-4149-bb6c-8e2bde7b83ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" acquired by "delete_volume" :: waited 0.030s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f75cdc-2514-4f8c-8cc6-bd5006cf25c5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-1c77fff0-92bc-449c-9be0-79af4a8f101e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-1c77fff0-92bc-449c-9be0-79af4a8f101e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-1c77fff0-92bc-449c-9be0-79af4a8f101e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-1c77fff0-92bc-449c-9be0-79af4a8f101e" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab Jul 23 03:36:14 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb160053-a0f3-4bb2-ab34-0e67aa038d1d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e Jul 23 03:36:15 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" returned: 0 in 0.528s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab Jul 23 03:36:15 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Flow 'volume_create_manager' (db815e91-1c51-4b86-9092-c906d1baa998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad00a1e-874c-4cdb-a370-f2f67071b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:15 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e" returned: 0 in 0.542s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad00a1e-874c-4cdb-a370-f2f67071b942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1604423198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663dff60-2a7e-41ea-9992-552eeb2f5aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d2861d660046c19e5bad51fec0e708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=044757e3-2106-45cc-8363-d04ebcac5b6a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:15Z,use_quota=True,user_id='1907d9f5c13446dda50694ef7e7869e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182408f6-bf09-4102-abe2-2eccb32ee529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182408f6-bf09-4102-abe2-2eccb32ee529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a710d0-1236-45fe-b99c-7b1696d4fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:15 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a710d0-1236-45fe-b99c-7b1696d4fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '663dff60-2a7e-41ea-9992-552eeb2f5aa3', 'volume_name': 'volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3', 'volume_size': 1, 'snapshot_id': '044757e3-2106-45cc-8363-d04ebcac5b6a'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:15 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97516fc7-8621-44fc-acea-f1a90b32b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97516fc7-8621-44fc-acea-f1a90b32b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ac99c5-5ece-49df-bfd9-06f36b9e68e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:15 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Volume 663dff60-2a7e-41ea-9992-552eeb2f5aa3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3', 'volume_size': 1, 'snapshot_id': '044757e3-2106-45cc-8363-d04ebcac5b6a'} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a-663dff60-2a7e-41ea-9992-552eeb2f5aa3" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a-663dff60-2a7e-41ea-9992-552eeb2f5aa3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Creating volume 663dff60-2a7e-41ea-9992-552eeb2f5aa3 from snapshot 044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] snapshot: 044757e3-2106-45cc-8363-d04ebcac5b6a, volume: 663dff60-2a7e-41ea-9992-552eeb2f5aa3, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3009a1f-7a2c-421c-a6ac-c411376b4475]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" returned: 0 in 0.433s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c018239d-8ff2-4149-bb6c-8e2bde7b83ab" released by "delete_volume" :: held 1.058s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Created reservations ['c2485113-d5b0-41a7-9c77-f3ea72327bb4', '6ff707b8-90e1-496a-bda9-7c8b172dd743', '9b4e99cc-4a9c-4fe7-8957-a4b4992739bd', '9f7b47fd-600a-4bc5-b5dd-7a61a6823bc6'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:15 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:15 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-1c77fff0-92bc-449c-9be0-79af4a8f101e" returned: 0 in 0.439s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-1c77fff0-92bc-449c-9be0-79af4a8f101e" released by "delete_volume" :: held 1.047s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:15 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:16 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['06b5cad8-0358-4f83-88d0-192e6763945d', 'b745d7db-1464-4702-8ae6-3cd30f3db8e7', '1e99f602-0e03-4e3e-867e-ab71df3b9916', '2bfedb4c-dccc-43a1-a186-297710dbc03b'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:16 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:16 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:16 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6e343c-50e2-4784-bea5-8ae0a5ffec32]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:16 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.333s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Deleted volume successfully. Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a5861e38-6b68-4b96-aac6-11ce92c13622 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c018239d-8ff2-4149-bb6c-8e2bde7b83ab-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:16 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:16 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:16 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-37cb2f14-4b4c-414c-ab6d-c370637de151 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-1c77fff0-92bc-449c-9be0-79af4a8f101e-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.352s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:36:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:16 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 Jul 23 03:36:16 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-fecc2a29-6973-42af-8299-1855aa2e305c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-fecc2a29-6973-42af-8299-1855aa2e305c-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-fecc2a29-6973-42af-8299-1855aa2e305c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-fecc2a29-6973-42af-8299-1855aa2e305c" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[05651118-5a51-4453-adf9-8870d6adc356]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (e28ea5cb-7264-40aa-a43d-69166005ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16e2bb-c349-485d-adc3-72c1f6cd31e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:17 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c Jul 23 03:36:17 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16e2bb-c349-485d-adc3-72c1f6cd31e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189470119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a209853-6be8-41a3-887f-3a7aefd631b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:18Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c2ac58-a5c4-493e-9c02-736c35fd606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c2ac58-a5c4-493e-9c02-736c35fd606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6101a9-30b5-4c0f-b203-c6d3c1aa783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6101a9-30b5-4c0f-b203-c6d3c1aa783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a209853-6be8-41a3-887f-3a7aefd631b5', 'volume_name': 'volume-3a209853-6be8-41a3-887f-3a7aefd631b5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e432e66-85f9-4e1c-8cb6-3e1fe326e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e432e66-85f9-4e1c-8cb6-3e1fe326e791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cca40c-d66d-4ee7-a882-ac5d5d22ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:17 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Volume 3a209853-6be8-41a3-887f-3a7aefd631b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a209853-6be8-41a3-887f-3a7aefd631b5', 'volume_size': 1} Jul 23 03:36:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:18 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c" returned: 0 in 0.594s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:18 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c Jul 23 03:36:18 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:18 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-fecc2a29-6973-42af-8299-1855aa2e305c" returned: 0 in 0.419s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-fecc2a29-6973-42af-8299-1855aa2e305c" released by "delete_volume" :: held 1.144s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['e6e9e7a8-bc3a-489c-9963-fbaf993c9a98', '8c303ba3-dbce-4b73-852f-537752ac7724', '2efa4c7f-a944-4325-a178-03261d3acc52', 'fb4ece8a-21ab-4562-b1e6-25ab98a14da5'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:19 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:19 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:19 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:19 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-17daad63-562d-4cb3-a63c-3e6baaad49f0 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-fecc2a29-6973-42af-8299-1855aa2e305c-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-e7e45d11-396c-4706-89e3-5cb13e846779-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-e7e45d11-396c-4706-89e3-5cb13e846779-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:19 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-e7e45d11-396c-4706-89e3-5cb13e846779" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-e7e45d11-396c-4706-89e3-5cb13e846779" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleting offline snapshot e7e45d11-396c-4706-89e3-5cb13e846779 of volume 3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] snapshot_file for this snap is: volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9d610-49a3-4fa5-9149-fa9fa4a82df0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:20 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 Jul 23 03:36:20 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:20 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779" returned: 0 in 0.711s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b857a09-427f-40ac-befc-ed58a49281d7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 Jul 23 03:36:21 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3" returned: 0 in 4.719s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7ec34-adf4-4103-bcc9-6998457ff86d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:21 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" returned: 0 in 0.628s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 Jul 23 03:36:21 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779 Jul 23 03:36:21 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:36:21 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Converted 1024.00 MB image at 216.95 MB/s Jul 23 03:36:21 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 is being set with open permissions: ugo+rw Jul 23 03:36:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 Jul 23 03:36:21 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234.e7e45d11-396c-4706-89e3-5cb13e846779" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-e7e45d11-396c-4706-89e3-5cb13e846779" released by "_delete_snapshot" :: held 2.094s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:22 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" released by "delete_snapshot" :: held 2.145s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" released by "_copy_volume_from_snapshot" :: held 6.469s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a-663dff60-2a7e-41ea-9992-552eeb2f5aa3" released by "_create_volume_from_snapshot" :: held 6.504s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.527s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189470119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a209853-6be8-41a3-887f-3a7aefd631b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:18Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Creating volume 3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 1073741824 Jul 23 03:36:22 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ac99c5-5ece-49df-bfd9-06f36b9e68e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3', 'volume_size': 1, 'snapshot_id': '044757e3-2106-45cc-8363-d04ebcac5b6a'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0510b225-a296-4323-80ce-ae18a23f45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Volume volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 (663dff60-2a7e-41ea-9992-552eeb2f5aa3): created successfully Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0510b225-a296-4323-80ce-ae18a23f45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Flow 'volume_create_manager' (db815e91-1c51-4b86-9092-c906d1baa998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['c9fd6661-3a35-44cb-b96a-e732fa225cc3', '9956da59-e567-4a8f-9599-42d4c624ae83', 'bb0be236-d139-45b0-9427-e69ad821166b', '93ea9107-9062-4693-8cb7-3ff6bf85a463'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-76cfbd0d-dea1-4a1d-bc67-6dcfe97c7e57 tempest-VolumeDependencyTests-609820565 None] Created volume successfully. Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Delete snapshot completed successfully. Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-961d835b-9c97-469b-9234-3ace55db2774 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-e7e45d11-396c-4706-89e3-5cb13e846779-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:22 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 1073741824" returned: 0 in 0.405s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 Jul 23 03:36:22 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5" returned: 0 in 0.236s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cca40c-d66d-4ee7-a882-ac5d5d22ad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a209853-6be8-41a3-887f-3a7aefd631b5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d85945a-7af9-4cf3-a570-75e0be45403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Volume volume-3a209853-6be8-41a3-887f-3a7aefd631b5 (3a209853-6be8-41a3-887f-3a7aefd631b5): created successfully Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d85945a-7af9-4cf3-a570-75e0be45403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:22 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (e28ea5cb-7264-40aa-a43d-69166005ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:22 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fb05e4e2-98b2-463d-893f-ae15ec1d54c6 tempest-ProjectReaderTests-1489480249 None] Created volume successfully. Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-3b7d27d6-d9e2-4357-bf62-17bf6dd97234-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-044757e3-2106-45cc-8363-d04ebcac5b6a-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-044757e3-2106-45cc-8363-d04ebcac5b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-3b7d27d6-d9e2-4357-bf62-17bf6dd97234-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Deleting offline snapshot 044757e3-2106-45cc-8363-d04ebcac5b6a of volume d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] snapshot_file for this snap is: volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[11222298-504b-4a32-998d-72bdff35d188]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[87847c0e-38f5-44e5-ad83-a4a254c921fb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:23 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 Jul 23 03:36:23 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b32468-5f02-4adc-b7d5-a6fdc5844102]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" returned: 0 in 0.353s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234 Jul 23 03:36:23 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:23 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-quobyte-3b7d27d6-d9e2-4357-bf62-17bf6dd97234" released by "delete_volume" :: held 0.657s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:23 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Created reservations ['53fc9700-7615-4ac6-a355-6a8e1086da79', '436a2ba7-debc-45ea-89dd-fd85f7bd39d4', 'b4ec64ef-c4b3-468f-8631-fc6ead59f0e1', 'fabc0e49-f94a-4f9a-88b7-936d727c64e6'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:23 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.365s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:24 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:24 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Creating offline snapshot 0157ea0f-6e18-40f2-8671-2af395010169 of volume 3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a76d3f-a54f-472a-babb-2a73bbc75a2f]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 Jul 23 03:36:24 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Deleted volume successfully. Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-6a366aab-e52f-4ca9-9d79-1f07a02d8db1 tempest-CreateVolumesFromSnapshotTest-626845001 None] Lock "cinder-3b7d27d6-d9e2-4357-bf62-17bf6dd97234-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:24 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.440s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a Jul 23 03:36:24 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5" returned: 0 in 0.439s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 1G Jul 23 03:36:24 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea.044757e3-2106-45cc-8363-d04ebcac5b6a" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-044757e3-2106-45cc-8363-d04ebcac5b6a" released by "_delete_snapshot" :: held 1.548s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" released by "delete_snapshot" :: held 1.578s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Created reservations ['e6fcd57e-9834-4d9e-b8b4-d515f4a1265e', 'fd02eaa6-2539-4422-bf4b-069ae7c144df', 'c286b64a-a6ba-4f08-a290-262ae9286f0b', 'fc01d60d-528f-4d5e-bd46-e7403fbac2b5'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Delete snapshot completed successfully. Jul 23 03:36:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e1b18967-e81a-4c49-8f41-5bec514b16ce tempest-VolumeDependencyTests-609820565 None] Lock "cinder-044757e3-2106-45cc-8363-d04ebcac5b6a-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:25 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 1G" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a209853-6be8-41a3-887f-3a7aefd631b5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a209853-6be8-41a3-887f-3a7aefd631b5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 Jul 23 03:36:25 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "cinder-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:25 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a209853-6be8-41a3-887f-3a7aefd631b5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169" returned: 0 in 0.338s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 is being set with open permissions: ugo+rw Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:25 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 Jul 23 03:36:25 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fc5685-376e-4ce7-bacb-38d54eba4308]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:25 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169" returned: 0 in 0.307s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info Jul 23 03:36:25 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea Jul 23 03:36:25 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:26 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info is being set with open permissions: ugo+rw Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:26 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info Jul 23 03:36:26 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:26 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea" released by "delete_volume" :: held 0.745s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Created reservations ['af5ed111-9de6-4ccb-b314-d4da96ac5872', 'a515bdd1-50d1-44b2-b9c4-1fc2c03d3c88', 'fd414134-908e-44cf-b740-589522720b00', '2038b6a1-4614-4c8d-9f04-ed749d1200a0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:26 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.info" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:26 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1e6e84af-7ad8-4f93-99d8-3cf5e0e9bd02 tempest-ProjectReaderTests-1489480249 None] Create snapshot completed successfully Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-663dff60-2a7e-41ea-9992-552eeb2f5aa3-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-663dff60-2a7e-41ea-9992-552eeb2f5aa3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:26 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.289s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Deleted volume successfully. Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9d150a41-15e0-493d-97b3-af30c568574d tempest-VolumeDependencyTests-609820565 None] Lock "cinder-d8d0b0cc-f962-4790-8ef2-6e61fd0236ea-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[868490d3-87f9-4fac-97e6-fed6fc37cfbf]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:26 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 Jul 23 03:36:26 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3" returned: 0 in 0.358s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:27 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3 Jul 23 03:36:27 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-663dff60-2a7e-41ea-9992-552eeb2f5aa3" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-quobyte-663dff60-2a7e-41ea-9992-552eeb2f5aa3" released by "delete_volume" :: held 0.667s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Created reservations ['9c7dfb66-8ecc-4352-8607-e6fba30aa6ee', '2db40537-14e6-4156-90ab-a7eaba1e9d9a', '97fcadac-80a5-4ddb-868d-65b7a7a98070', 'b662c1e3-8cc3-457e-97ee-fe20ac0a3dcc'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-0157ea0f-6e18-40f2-8671-2af395010169-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-0157ea0f-6e18-40f2-8671-2af395010169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-0157ea0f-6e18-40f2-8671-2af395010169" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-0157ea0f-6e18-40f2-8671-2af395010169" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Deleting offline snapshot 0157ea0f-6e18-40f2-8671-2af395010169 of volume 3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] snapshot_file for this snap is: volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[6232097e-88be-400a-91e6-7fc38ffe1bce]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:27 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:27 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 Jul 23 03:36:27 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.280s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Deleted volume successfully. Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-3ef4732a-2f3b-4b9a-9aff-40ce92e41f91 tempest-VolumeDependencyTests-609820565 None] Lock "cinder-663dff60-2a7e-41ea-9992-552eeb2f5aa3-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:27 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169" returned: 0 in 0.444s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a209853-6be8-41a3-887f-3a7aefd631b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a888b622-0413-4c7f-b9b0-fa0f37ea8f64]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:28 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 Jul 23 03:36:28 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:28 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:28 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 Jul 23 03:36:28 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:28 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169" returned: 0 in 0.490s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:28 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169 Jul 23 03:36:28 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:29 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5.0157ea0f-6e18-40f2-8671-2af395010169" returned: 0 in 0.317s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-0157ea0f-6e18-40f2-8671-2af395010169" released by "_delete_snapshot" :: held 1.756s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" released by "delete_snapshot" :: held 1.784s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:UPDATE=274,cinder:SELECT=202,cinder:DELETE=20,cinder:INSERT=66 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=192,cinder:INSERT=79,cinder:UPDATE=266,cinder:DELETE=29 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Created reservations ['aedbf951-8987-41c8-8a2c-ed85a5196f07', 'cc813711-cd0b-4767-914c-5f4d359d083b', '33d59832-108a-4513-8b2e-3ed3c4310658', '5cc414af-e256-4948-b57d-ed74abb10d30'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Delete snapshot completed successfully. Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bfa1ea19-5b18-4bc7-a6a9-27e20774949d tempest-ProjectReaderTests-1489480249 None] Lock "cinder-0157ea0f-6e18-40f2-8671-2af395010169-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-3a209853-6be8-41a3-887f-3a7aefd631b5-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-3a209853-6be8-41a3-887f-3a7aefd631b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f66a893-fe15-4701-8c4b-736221ca597a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:29 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 Jul 23 03:36:29 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:30 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5" returned: 0 in 0.456s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:30 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5 Jul 23 03:36:30 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:30 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3a209853-6be8-41a3-887f-3a7aefd631b5" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-3a209853-6be8-41a3-887f-3a7aefd631b5" released by "delete_volume" :: held 0.829s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Created reservations ['6bab8029-8f57-4d8d-b8c6-d64614383345', 'ebd9f748-4345-4785-b8d4-074fb5cab77c', '627320d5-9077-44d9-8167-afe2d0372076', '49d34922-92dc-4ec7-a481-a3471cff6a32'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:30 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:30 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:31 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.291s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Deleted volume successfully. Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-b3776d6e-e82f-47a6-a93d-9850b5573713 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-3a209853-6be8-41a3-887f-3a7aefd631b5-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (c512be22-b68f-4683-b1c1-383c21bd98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf724f-b296-4922-9e27-e3485c37f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Flow 'volume_create_manager' (1780041f-2931-473d-96fa-a74b5a4d7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7866441b-9dac-4bbc-b5d6-04501ed606bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf724f-b296-4922-9e27-e3485c37f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267690401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:31Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36cc3720-d7ce-4867-9f3c-ff25a77ebab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36cc3720-d7ce-4867-9f3c-ff25a77ebab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879b557-ba89-4e84-8e57-e5b38679249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f879b557-ba89-4e84-8e57-e5b38679249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5', 'volume_name': 'volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbfda5e-b7ec-45a5-86d3-b480178abff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbfda5e-b7ec-45a5-86d3-b480178abff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830e4955-28ec-4c96-9dc9-6771b83a6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Volume 2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5', 'volume_size': 1} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267690401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:31Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Creating volume 2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:31 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7866441b-9dac-4bbc-b5d6-04501ed606bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6094b85-f030-4e6d-9de3-279458dd24e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37fe6a2dbbb446bb147f24754895c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:32Z,use_quota=True,user_id='db6f4f3ba9244cf1a6820474809f1583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9fe470-8230-45ea-a7ac-d382f69f457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9fe470-8230-45ea-a7ac-d382f69f457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66019d45-b297-4fe3-aa90-2b870843fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 1073741824 Jul 23 03:36:31 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66019d45-b297-4fe3-aa90-2b870843fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6094b85-f030-4e6d-9de3-279458dd24e2', 'volume_name': 'volume-d6094b85-f030-4e6d-9de3-279458dd24e2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bb4c1-af5b-42b5-a193-22708444d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bb4c1-af5b-42b5-a193-22708444d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dd5563-6b3d-423e-9858-4bfeed4b77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:31 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Volume d6094b85-f030-4e6d-9de3-279458dd24e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6094b85-f030-4e6d-9de3-279458dd24e2', 'volume_size': 1} Jul 23 03:36:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:32 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 1073741824" returned: 0 in 0.531s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:32 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 Jul 23 03:36:32 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:32 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6094b85-f030-4e6d-9de3-279458dd24e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37fe6a2dbbb446bb147f24754895c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:32Z,use_quota=True,user_id='db6f4f3ba9244cf1a6820474809f1583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Creating volume d6094b85-f030-4e6d-9de3-279458dd24e2 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:32 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:32 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 1073741824 Jul 23 03:36:32 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830e4955-28ec-4c96-9dc9-6771b83a6bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae76f82-ec60-4e54-8cf1-78ab7e54aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:32 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Volume volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 (2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5): created successfully Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae76f82-ec60-4e54-8cf1-78ab7e54aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:32 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (c512be22-b68f-4683-b1c1-383c21bd98c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:32 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-4ca22c18-b970-4ea4-88a6-78c0948c5b18 tempest-ProjectReaderTests-1489480249 None] Created volume successfully. Jul 23 03:36:33 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 1073741824" returned: 0 in 0.453s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:33 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 Jul 23 03:36:33 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:33 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dd5563-6b3d-423e-9858-4bfeed4b77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6094b85-f030-4e6d-9de3-279458dd24e2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e9625-51b0-431d-a622-b32805f39752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:33 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Volume volume-d6094b85-f030-4e6d-9de3-279458dd24e2 (d6094b85-f030-4e6d-9de3-279458dd24e2): created successfully Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e9625-51b0-431d-a622-b32805f39752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Flow 'volume_create_manager' (1780041f-2931-473d-96fa-a74b5a4d7c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:33 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b7ea125d-80be-4ed8-9981-59682264cc0a tempest-CinderUnicodeTest-1214931578 None] Created volume successfully. Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Creating offline snapshot c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b of volume 2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776281d-f3a9-4948-b04a-424eb595cda1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:33 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 Jul 23 03:36:33 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:34 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" returned: 0 in 0.446s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:34 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b 1G Jul 23 03:36:34 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Flow 'volume_create_manager' (707452b2-edcf-47bc-9cb3-06632b4b3b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a23e898-f5c4-43e0-afb6-a6aa23355f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a23e898-f5c4-43e0-afb6-a6aa23355f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-704496216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91124c-580b-4061-9abf-3df36c5dfc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37fe6a2dbbb446bb147f24754895c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:34Z,use_quota=True,user_id='db6f4f3ba9244cf1a6820474809f1583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6467878-8f1c-4416-ab5c-2ef24f3767b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6467878-8f1c-4416-ab5c-2ef24f3767b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47e654c-28f3-4c35-b5eb-1aa07832fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47e654c-28f3-4c35-b5eb-1aa07832fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b91124c-580b-4061-9abf-3df36c5dfc32', 'volume_name': 'volume-3b91124c-580b-4061-9abf-3df36c5dfc32', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddabfeca-ff56-4c8a-b4bb-6cd51767afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddabfeca-ff56-4c8a-b4bb-6cd51767afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b8c6d-6569-45af-901f-8b8266e1b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:34 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Volume 3b91124c-580b-4061-9abf-3df36c5dfc32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b91124c-580b-4061-9abf-3df36c5dfc32', 'volume_size': 1} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:34 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b 1G" returned: 0 in 0.457s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:34 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b Jul 23 03:36:34 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:34 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" returned: 0 in 0.306s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:34 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b is being set with open permissions: ugo+rw Jul 23 03:36:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:34 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b Jul 23 03:36:34 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:35 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" returned: 0 in 0.299s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:35 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info Jul 23 03:36:35 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:35 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info" returned: 0 in 0.272s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:35 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info is being set with open permissions: ugo+rw Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:35 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info Jul 23 03:36:35 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:35 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.info" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-704496216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91124c-580b-4061-9abf-3df36c5dfc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37fe6a2dbbb446bb147f24754895c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:34Z,use_quota=True,user_id='db6f4f3ba9244cf1a6820474809f1583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Creating volume 3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:35 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:35 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 1073741824 Jul 23 03:36:35 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:35 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e9c05e6d-969a-4722-9644-7ed4fb0f9ddd tempest-ProjectReaderTests-1489480249 None] Create snapshot completed successfully Jul 23 03:36:36 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 1073741824" returned: 0 in 0.469s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:36 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 Jul 23 03:36:36 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:36 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b8c6d-6569-45af-901f-8b8266e1b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b91124c-580b-4061-9abf-3df36c5dfc32', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2acfa8-e0a2-4345-9398-a9ce6f33c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Volume volume-3b91124c-580b-4061-9abf-3df36c5dfc32 (3b91124c-580b-4061-9abf-3df36c5dfc32): created successfully Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2acfa8-e0a2-4345-9398-a9ce6f33c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Flow 'volume_create_manager' (707452b2-edcf-47bc-9cb3-06632b4b3b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3299b663-42b1-44eb-825e-12611a69633d tempest-CinderUnicodeTest-1214931578 None] Created volume successfully. Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Deleting offline snapshot c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b of volume 2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] snapshot_file for this snap is: volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031c0f7-a0eb-474f-8120-c29bb5f88bba]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:36 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b Jul 23 03:36:36 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:37 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" returned: 0 in 0.385s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde1e86-f2b5-4322-bddd-d56279482a41]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:37 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 Jul 23 03:36:37 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Creating offline snapshot f65b18c9-9c93-4b18-8607-7b46de38bc7b of volume 3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a66b25-afd9-4596-9529-586274b7e641]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:37 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" returned: 0 in 0.368s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:37 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b Jul 23 03:36:37 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:37 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 Jul 23 03:36:37 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:37 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" returned: 0 in 0.336s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:37 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b Jul 23 03:36:38 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:38 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32" returned: 0 in 0.381s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:38 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b 1G Jul 23 03:36:38 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:38 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5.c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" returned: 0 in 0.233s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b" released by "_delete_snapshot" :: held 1.450s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" released by "delete_snapshot" :: held 1.478s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Created reservations ['3c6e75d4-5ee7-42ba-b85f-a528a6550bf8', '313ef67e-520d-4569-b823-c67f8249400b', 'c2cd9cd5-2f9c-4e43-98a7-615bcd6d1d27', 'd17174bb-5802-41d7-be08-73ee2886e441'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Delete snapshot completed successfully. Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5f5e836f-48d3-427e-a6ba-dcd514bc6f07 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c48f762c-4e2e-4fad-8c41-cfa1fb54fe6b-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:38 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b 1G" returned: 0 in 0.469s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91124c-580b-4061-9abf-3df36c5dfc32 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:38 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91124c-580b-4061-9abf-3df36c5dfc32 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b Jul 23 03:36:38 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:38 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b91124c-580b-4061-9abf-3df36c5dfc32 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b" returned: 0 in 0.302s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:38 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b is being set with open permissions: ugo+rw Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:38 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b Jul 23 03:36:38 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:38 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:39 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b" returned: 0 in 0.267s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8cde5-1bdb-43af-ab7d-5e2bab0805f0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:39 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info Jul 23 03:36:39 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:39 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 Jul 23 03:36:39 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:39 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info" returned: 0 in 0.320s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:39 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info is being set with open permissions: ugo+rw Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:39 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info Jul 23 03:36:39 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:39 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" returned: 0 in 0.472s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:39 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5 Jul 23 03:36:39 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:39 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.info" returned: 0 in 0.273s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:39 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cb7e2e3b-da41-4c4c-9425-8b11c212e5a3 tempest-CinderUnicodeTest-1214931578 None] Create snapshot completed successfully Jul 23 03:36:39 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5" released by "delete_volume" :: held 0.812s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Created reservations ['b3e7bb8e-f869-4a7b-97af-3c19279408b4', 'e7ae14e3-09c9-4426-b073-13c237700cb1', '91c74137-d803-4031-8adf-cd016d8c8c73', 'b7786daf-9d0f-4471-9e2a-2a56daf5a393'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:39 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:39 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:40 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:40 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Deleted volume successfully. Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-79b5ab5f-5cb8-47c4-a297-3147c72e0212 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-2dfb1191-dcc9-4cef-ae93-c6d0de01ebb5-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (96162a9a-9ee2-425c-ac47-a760b00bff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078c845a-df99-4489-82c6-c32f3097165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078c845a-df99-4489-82c6-c32f3097165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261316258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a6ef04-f9df-4e4e-9d91-62df4c4f2b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:41Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ccec83-140c-4101-baef-83c2f2a318d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ccec83-140c-4101-baef-83c2f2a318d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48221965-2690-4600-98bd-2e28ec1ebc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48221965-2690-4600-98bd-2e28ec1ebc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a6ef04-f9df-4e4e-9d91-62df4c4f2b22', 'volume_name': 'volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8c2c5-ffd1-4605-972b-fd00551ff81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8c2c5-ffd1-4605-972b-fd00551ff81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f0f71a-6f48-406a-8263-33615c162496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:40 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Volume 52a6ef04-f9df-4e4e-9d91-62df4c4f2b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22', 'volume_size': 1} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261316258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a6ef04-f9df-4e4e-9d91-62df4c4f2b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:41Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Creating volume 52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:40 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:40 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 1073741824 Jul 23 03:36:40 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-f65b18c9-9c93-4b18-8607-7b46de38bc7b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-f65b18c9-9c93-4b18-8607-7b46de38bc7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-quobyte-f65b18c9-9c93-4b18-8607-7b46de38bc7b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-f65b18c9-9c93-4b18-8607-7b46de38bc7b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Deleting offline snapshot f65b18c9-9c93-4b18-8607-7b46de38bc7b of volume 3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] snapshot_file for this snap is: volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a91fe2-2900-4dd0-909c-06c6d05031e4]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:41 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b Jul 23 03:36:41 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:41 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 1073741824" returned: 0 in 0.535s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:41 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 Jul 23 03:36:41 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:41 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b91124c-580b-4061-9abf-3df36c5dfc32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[edddc649-bfe7-4d86-84c1-3f32f3f6a5f8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:41 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 Jul 23 03:36:41 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:41 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" returned: 0 in 0.247s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f0f71a-6f48-406a-8263-33615c162496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33947f31-217b-4d5d-b4a2-3925d27e0a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:41 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Volume volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 (52a6ef04-f9df-4e4e-9d91-62df4c4f2b22): created successfully Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33947f31-217b-4d5d-b4a2-3925d27e0a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (96162a9a-9ee2-425c-ac47-a760b00bff7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7366f25b-c0ee-4b85-8842-f4fe322b0780 tempest-ProjectReaderTests-1489480249 None] Created volume successfully. Jul 23 03:36:41 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32" returned: 0 in 0.413s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:41 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b Jul 23 03:36:41 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:42 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b" returned: 0 in 0.348s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:42 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b Jul 23 03:36:42 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:42 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32.f65b18c9-9c93-4b18-8607-7b46de38bc7b" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-f65b18c9-9c93-4b18-8607-7b46de38bc7b" released by "_delete_snapshot" :: held 1.576s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" released by "delete_snapshot" :: held 1.607s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Created reservations ['cb8edbc8-6586-4e35-b9d5-9236bec9aa27', '85d1648d-8cac-4ab8-bf5c-1242ad7f3de2', 'f4b7dc4c-8b74-46da-ac71-006b697aed45', '90e2cf1a-562d-4146-961c-f12c7dd7201d'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:42 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Delete snapshot completed successfully. Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-a40380e5-6df0-498a-a32c-f71b5485fa2a tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-f65b18c9-9c93-4b18-8607-7b46de38bc7b-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Creating offline snapshot 642a1322-462c-447a-9db7-c752713bde09 of volume 52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e946ec5-72fd-4f9c-81fe-033178be35ed]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-3b91124c-580b-4061-9abf-3df36c5dfc32-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-3b91124c-580b-4061-9abf-3df36c5dfc32-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:43 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:43 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0767a1-bf19-450b-a855-47e8e4cd8dd3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:43 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 Jul 23 03:36:43 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:43 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" returned: 0 in 0.496s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:43 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 1G Jul 23 03:36:43 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:43 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32" returned: 0 in 0.424s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:43 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32 Jul 23 03:36:43 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:43 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3b91124c-580b-4061-9abf-3df36c5dfc32" returned: 0 in 0.252s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-3b91124c-580b-4061-9abf-3df36c5dfc32" released by "delete_volume" :: held 0.753s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Created reservations ['089a8738-5580-4135-b476-6c384ede5273', 'fa949e2e-5adc-40a3-85d3-bfb078958c8a', '61544a95-431e-4b3f-8802-273c47e5bf81', '984ae3ae-665a-4e68-adc3-47dccb154b78'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:43 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 1G" returned: 0 in 0.521s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:43 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 Jul 23 03:36:43 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:44 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:44 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-d6094b85-f030-4e6d-9de3-279458dd24e2-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-d6094b85-f030-4e6d-9de3-279458dd24e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "cinder-quobyte-d6094b85-f030-4e6d-9de3-279458dd24e2" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-d6094b85-f030-4e6d-9de3-279458dd24e2" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[99445656-72e7-439d-a061-c95d9e215a33]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:44 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:44 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 is being set with open permissions: ugo+rw Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:44 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.357s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Deleted volume successfully. Jul 23 03:36:44 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 Jul 23 03:36:44 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24486270-5071-4b5b-91c7-e37a6af20719 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-3b91124c-580b-4061-9abf-3df36c5dfc32-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:44 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 Jul 23 03:36:44 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:44 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:44 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info Jul 23 03:36:44 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:44 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2" returned: 0 in 0.424s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:44 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2 Jul 23 03:36:44 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:44 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info" returned: 0 in 0.307s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:44 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info is being set with open permissions: ugo+rw Jul 23 03:36:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:45 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info Jul 23 03:36:45 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:45 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d6094b85-f030-4e6d-9de3-279458dd24e2" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-quobyte-d6094b85-f030-4e6d-9de3-279458dd24e2" released by "delete_volume" :: held 0.765s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Created reservations ['99cf2e02-017b-4ad3-8a34-1f090e9d686a', 'c913d160-25c3-4ce9-a6c1-0d5699f6d0d8', '919de3ad-0518-4e54-a965-e280aaf3c0e9', '5e0f763a-9a16-4dfb-a97b-413918adb458'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:45 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:45 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:45 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.info" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-500df132-1936-4fe6-938e-a5c3f3dbc7ce tempest-ProjectReaderTests-1489480249 None] Create snapshot completed successfully Jul 23 03:36:45 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.332s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Deleted volume successfully. Jul 23 03:36:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-19446273-ac1e-4779-9740-2e0562461f04 tempest-CinderUnicodeTest-1214931578 None] Lock "cinder-d6094b85-f030-4e6d-9de3-279458dd24e2-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-642a1322-462c-447a-9db7-c752713bde09-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-642a1322-462c-447a-9db7-c752713bde09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-642a1322-462c-447a-9db7-c752713bde09" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-642a1322-462c-447a-9db7-c752713bde09" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Deleting offline snapshot 642a1322-462c-447a-9db7-c752713bde09 of volume 52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] snapshot_file for this snap is: volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5d2f21-45fe-4d64-a26b-65c7485fbe65]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:46 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 Jul 23 03:36:46 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:46 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09" returned: 0 in 0.465s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c250cda-dc89-4cbc-b0e4-1476bdf5d5db]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (88286fe0-9d8f-452c-8175-6d69c2a18000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8da57d3-4567-4880-9b2e-30f0a3b262a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8da57d3-4567-4880-9b2e-30f0a3b262a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820890905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81876f97-3f07-49b8-8d63-e9faecf9803a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:47Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f6ffaa-d23e-4a58-a69f-6c5d7e33e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f6ffaa-d23e-4a58-a69f-6c5d7e33e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dd1ae6-e3b4-41c3-96be-3b64a5200587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dd1ae6-e3b4-41c3-96be-3b64a5200587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81876f97-3f07-49b8-8d63-e9faecf9803a', 'volume_name': 'volume-81876f97-3f07-49b8-8d63-e9faecf9803a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:46 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 Jul 23 03:36:46 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72a089d-9630-479e-8b5b-62ba1fd8b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72a089d-9630-479e-8b5b-62ba1fd8b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c58565a-d420-4a07-a6e9-253c79374e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Volume 81876f97-3f07-49b8-8d63-e9faecf9803a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81876f97-3f07-49b8-8d63-e9faecf9803a', 'volume_size': 1} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820890905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81876f97-3f07-49b8-8d63-e9faecf9803a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:47Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Creating volume 81876f97-3f07-49b8-8d63-e9faecf9803a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:46 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a 1073741824 Jul 23 03:36:46 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:47 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" returned: 0 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:47 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 Jul 23 03:36:47 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:47 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a 1073741824" returned: 0 in 0.477s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:47 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a Jul 23 03:36:47 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:47 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:47 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09 Jul 23 03:36:47 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:47 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a" returned: 0 in 0.292s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c58565a-d420-4a07-a6e9-253c79374e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81876f97-3f07-49b8-8d63-e9faecf9803a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dcd83b-2485-443c-ac47-533bc08dbdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Volume volume-81876f97-3f07-49b8-8d63-e9faecf9803a (81876f97-3f07-49b8-8d63-e9faecf9803a): created successfully Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dcd83b-2485-443c-ac47-533bc08dbdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (88286fe0-9d8f-452c-8175-6d69c2a18000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-78491f46-bbd1-4127-9b94-4f02d719ec9e tempest-ProjectReaderTests-722455128 None] Created volume successfully. Jul 23 03:36:47 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22.642a1322-462c-447a-9db7-c752713bde09" returned: 0 in 0.293s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-642a1322-462c-447a-9db7-c752713bde09" released by "_delete_snapshot" :: held 1.677s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" released by "delete_snapshot" :: held 1.725s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:47 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:47 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Created reservations ['42628582-a0d0-4645-b07e-51ab14bd9e58', '8c3724b5-d426-48e7-a21e-3fbd563c641f', '751b350c-58f9-45d8-b5f9-8ac4abcd147c', '5859916b-c7d5-45f1-b00f-4933e702e870'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Delete snapshot completed successfully. Jul 23 03:36:47 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ba8c4d76-2955-4486-ad6b-94f8893e4661 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-642a1322-462c-447a-9db7-c752713bde09-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:48 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b67b9-68bf-4f4f-84f4-ac8f88b25c8b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:48 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 Jul 23 03:36:48 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:48 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:48 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22 Jul 23 03:36:48 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-e610550c-a362-407e-aff6-3f25d97a3c17 tempest-ProjectAdminTests-913928055 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88466) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:36:48 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" returned: 0 in 0.298s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:48 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-81876f97-3f07-49b8-8d63-e9faecf9803a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22" released by "delete_volume" :: held 0.750s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "cinder-81876f97-3f07-49b8-8d63-e9faecf9803a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-quobyte-81876f97-3f07-49b8-8d63-e9faecf9803a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-81876f97-3f07-49b8-8d63-e9faecf9803a" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Created reservations ['40b26217-a352-4837-88e7-83fbe8bbc89d', 'ba4fa9e8-d071-447a-bda2-a39f1d8709dc', 'd35b4dd7-54bd-4e98-a2c5-32aa2a821506', '0ba17893-bc61-4859-b6dc-7db410756004'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd4aad-3ca3-454f-87aa-60956fa1a7a5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:49 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:49 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:49 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a Jul 23 03:36:49 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:49 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.311s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:49 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Deleted volume successfully. Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-d8522986-7ce0-4acf-9838-0fa8ceea8555 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-52a6ef04-f9df-4e4e-9d91-62df4c4f2b22-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:49 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a" returned: 0 in 0.470s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:49 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a Jul 23 03:36:49 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:49 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (2eaf4951-9fd0-4885-9995-2cc7ce58bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33243b5-9bf3-4aad-9646-e8e747e3b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-81876f97-3f07-49b8-8d63-e9faecf9803a" returned: 0 in 0.352s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33243b5-9bf3-4aad-9646-e8e747e3b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202709491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c0e0e1-625f-4918-8db5-aacd216d143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:50Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba5f382-a53d-4b89-9c7c-348ec94c5a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba5f382-a53d-4b89-9c7c-348ec94c5a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880a96e5-60d2-430d-a6d6-aac0dd2810d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880a96e5-60d2-430d-a6d6-aac0dd2810d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c0e0e1-625f-4918-8db5-aacd216d143c', 'volume_name': 'volume-c4c0e0e1-625f-4918-8db5-aacd216d143c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c70f7ac-fe19-4f97-a1ab-bfa64524f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c70f7ac-fe19-4f97-a1ab-bfa64524f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea8c183-f59e-4d9d-8bc7-a295a2e57915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Volume c4c0e0e1-625f-4918-8db5-aacd216d143c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c0e0e1-625f-4918-8db5-aacd216d143c', 'volume_size': 1} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-202709491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c0e0e1-625f-4918-8db5-aacd216d143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a834d4b8ebde42dd93ed39def484b71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:50Z,use_quota=True,user_id='366d6346d56f44f4a04e381bbdc77dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Creating volume c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:50 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-81876f97-3f07-49b8-8d63-e9faecf9803a" released by "delete_volume" :: held 0.942s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:50 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c 1073741824 Jul 23 03:36:50 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Created reservations ['c3d095e9-2f3f-4f89-8398-700901bd2fdb', '677274c3-c943-45d7-aa2a-4f24d2868ee0', 'f15e1eea-266c-428c-8c1a-3b65927fb875', 'a6f1db50-5efa-4eb2-b79e-c1a38e7869cb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:50 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:50 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:50 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Deleted volume successfully. Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-2614e32d-b67c-4d0c-bd5c-e39a835f28f3 tempest-ProjectReaderTests-722455128 None] Lock "cinder-81876f97-3f07-49b8-8d63-e9faecf9803a-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:50 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c 1073741824" returned: 0 in 0.554s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:50 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c Jul 23 03:36:50 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:50 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea8c183-f59e-4d9d-8bc7-a295a2e57915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c0e0e1-625f-4918-8db5-aacd216d143c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e7594d-397d-4a3c-b7ab-a81a6a95ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:50 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Volume volume-c4c0e0e1-625f-4918-8db5-aacd216d143c (c4c0e0e1-625f-4918-8db5-aacd216d143c): created successfully Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e7594d-397d-4a3c-b7ab-a81a6a95ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:50 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Flow 'volume_create_manager' (2eaf4951-9fd0-4885-9995-2cc7ce58bce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1454e0ef-6538-4b9e-bed6-a58030409d06 tempest-ProjectReaderTests-1489480249 None] Created volume successfully. Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (a3498dcd-115e-46bd-9319-4513c1287954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552c0d4-d31b-4539-8b28-45667ba607c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552c0d4-d31b-4539-8b28-45667ba607c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313596295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a301b0cc-82e2-45bb-a152-481205c8e08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:52Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d4eb6-9f47-4315-a09b-c30d7f564f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d4eb6-9f47-4315-a09b-c30d7f564f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a181ce53-7642-45f6-abd5-b6da922a2bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a181ce53-7642-45f6-abd5-b6da922a2bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a301b0cc-82e2-45bb-a152-481205c8e08b', 'volume_name': 'volume-a301b0cc-82e2-45bb-a152-481205c8e08b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b543e5-bcad-429d-9109-dd007ce6d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b543e5-bcad-429d-9109-dd007ce6d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecedde1a-218e-40ea-96cb-b543a1179476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:51 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Volume a301b0cc-82e2-45bb-a152-481205c8e08b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a301b0cc-82e2-45bb-a152-481205c8e08b', 'volume_size': 1} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1313596295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a301b0cc-82e2-45bb-a152-481205c8e08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:52Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Creating volume a301b0cc-82e2-45bb-a152-481205c8e08b {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:51 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:51 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b 1073741824 Jul 23 03:36:51 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:52 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b 1073741824" returned: 0 in 0.477s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:52 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b Jul 23 03:36:52 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:52 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b" returned: 0 in 0.249s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecedde1a-218e-40ea-96cb-b543a1179476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a301b0cc-82e2-45bb-a152-481205c8e08b', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90f87fb-492d-4535-9bba-3ba1317b172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Creating offline snapshot 61cd4e9f-0d8a-444a-951a-c6be4acb69cc of volume c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:52 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Volume volume-a301b0cc-82e2-45bb-a152-481205c8e08b (a301b0cc-82e2-45bb-a152-481205c8e08b): created successfully Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90f87fb-492d-4535-9bba-3ba1317b172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (a3498dcd-115e-46bd-9319-4513c1287954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3388cd-b32c-484b-bc11-dff7f4d866bc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-26a104ce-767d-4f61-8ab2-1666e2c382ee tempest-ProjectReaderTests-722455128 None] Created volume successfully. Jul 23 03:36:52 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c Jul 23 03:36:52 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-a301b0cc-82e2-45bb-a152-481205c8e08b-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "cinder-a301b0cc-82e2-45bb-a152-481205c8e08b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-quobyte-a301b0cc-82e2-45bb-a152-481205c8e08b" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-a301b0cc-82e2-45bb-a152-481205c8e08b" acquired by "delete_volume" :: waited 0.034s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[75661a43-3908-4ace-9a38-1c824b15c453]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (caca805f-f976-4650-bbca-583a42068cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:53 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af630a-0b3e-4712-a9cc-5eeb3c4edd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c" returned: 0 in 0.476s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b Jul 23 03:36:53 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:53 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc 1G Jul 23 03:36:53 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af630a-0b3e-4712-a9cc-5eeb3c4edd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21224873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f32d103-4d2b-46c6-b3a6-27351f027618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:53Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7bcfd-42d8-4778-84fe-121bfea42d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7bcfd-42d8-4778-84fe-121bfea42d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcee1eef-70f2-4323-8619-8bcd031c5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcee1eef-70f2-4323-8619-8bcd031c5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f32d103-4d2b-46c6-b3a6-27351f027618', 'volume_name': 'volume-6f32d103-4d2b-46c6-b3a6-27351f027618', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565c50ca-24d2-407b-b10e-6030aa051ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565c50ca-24d2-407b-b10e-6030aa051ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9b902c-2f90-4bf6-8525-423ebbe6ed83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:53 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Volume 6f32d103-4d2b-46c6-b3a6-27351f027618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f32d103-4d2b-46c6-b3a6-27351f027618', 'volume_size': 1} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:53 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b" returned: 0 in 0.390s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b Jul 23 03:36:53 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:53 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc 1G" returned: 0 in 0.413s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c0e0e1-625f-4918-8db5-aacd216d143c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c0e0e1-625f-4918-8db5-aacd216d143c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc Jul 23 03:36:53 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:53 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-a301b0cc-82e2-45bb-a152-481205c8e08b" returned: 0 in 0.263s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-a301b0cc-82e2-45bb-a152-481205c8e08b" released by "delete_volume" :: held 0.716s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Created reservations ['a82d2639-3ec0-4146-87ae-162e61dbd54a', '2656d189-2ba0-4b22-add7-f48e6942164a', '004fac61-c32d-4843-887d-0669a5f8bfe5', '4c59cbd6-5fe9-4e4d-94cc-b2bea58586e1'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:53 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:53 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c0e0e1-625f-4918-8db5-aacd216d143c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc" returned: 0 in 0.323s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:53 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc is being set with open permissions: ugo+rw Jul 23 03:36:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:53 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc Jul 23 03:36:53 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:54 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Deleted volume successfully. Jul 23 03:36:54 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-29044f89-1238-45d1-a7c1-ccc429e0691e tempest-ProjectReaderTests-722455128 None] Lock "cinder-a301b0cc-82e2-45bb-a152-481205c8e08b-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:54 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info Jul 23 03:36:54 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:54 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:54 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info is being set with open permissions: ugo+rw Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:54 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info Jul 23 03:36:54 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (ee3ee1ab-9a22-47a6-8f75-cd8d3cc99197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7528febe-0e97-4cce-9ac1-d2cd0c31aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7528febe-0e97-4cce-9ac1-d2cd0c31aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331742345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892bcc28-accd-4fa2-ad26-65ee42c9e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:54Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afed2d7-755c-4440-8ac2-1df02d8492c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afed2d7-755c-4440-8ac2-1df02d8492c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acfd9df-8bca-4339-b5ea-2c470cef5a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acfd9df-8bca-4339-b5ea-2c470cef5a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892bcc28-accd-4fa2-ad26-65ee42c9e998', 'volume_name': 'volume-892bcc28-accd-4fa2-ad26-65ee42c9e998', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b338a13-b552-455c-af4a-c7befab5cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b338a13-b552-455c-af4a-c7befab5cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a47001-75f8-4ef3-9e46-e34d4dead7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Volume 892bcc28-accd-4fa2-ad26-65ee42c9e998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892bcc28-accd-4fa2-ad26-65ee42c9e998', 'volume_size': 1} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:54 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.info" returned: 0 in 0.257s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21224873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f32d103-4d2b-46c6-b3a6-27351f027618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:53Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Creating volume 6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:54 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:54 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 1073741824 Jul 23 03:36:54 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-74081043-24d7-45b8-9019-b2452715b352 tempest-ProjectReaderTests-1489480249 None] Create snapshot completed successfully Jul 23 03:36:55 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 1073741824" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:55 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 Jul 23 03:36:55 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:55 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331742345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892bcc28-accd-4fa2-ad26-65ee42c9e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:54Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Creating volume 892bcc28-accd-4fa2-ad26-65ee42c9e998 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:55 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-61cd4e9f-0d8a-444a-951a-c6be4acb69cc-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:55 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 1073741824 Jul 23 03:36:55 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9b902c-2f90-4bf6-8525-423ebbe6ed83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f32d103-4d2b-46c6-b3a6-27351f027618', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5468421-d6eb-4cf9-a269-9f3ac8b4c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-61cd4e9f-0d8a-444a-951a-c6be4acb69cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-61cd4e9f-0d8a-444a-951a-c6be4acb69cc" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Volume volume-6f32d103-4d2b-46c6-b3a6-27351f027618 (6f32d103-4d2b-46c6-b3a6-27351f027618): created successfully Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5468421-d6eb-4cf9-a269-9f3ac8b4c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (caca805f-f976-4650-bbca-583a42068cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-61cd4e9f-0d8a-444a-951a-c6be4acb69cc" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Deleting offline snapshot 61cd4e9f-0d8a-444a-951a-c6be4acb69cc of volume c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] snapshot_file for this snap is: volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-72c6ca8d-b7a2-4300-8536-b72874bd5213 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a097c-1fed-4265-952d-9a07e80bcef2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:55 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc Jul 23 03:36:55 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:55 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 1073741824" returned: 0 in 0.452s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:55 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 Jul 23 03:36:55 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:55 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc" returned: 0 in 0.397s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c0e0e1-625f-4918-8db5-aacd216d143c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[512419c6-7db0-4f11-a20c-b68a20785b18]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:56 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c Jul 23 03:36:56 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:56 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998" returned: 0 in 0.281s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a47001-75f8-4ef3-9e46-e34d4dead7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892bcc28-accd-4fa2-ad26-65ee42c9e998', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f94a81-fd63-49d3-894c-3eb688b37220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:56 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Volume volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 (892bcc28-accd-4fa2-ad26-65ee42c9e998): created successfully Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f94a81-fd63-49d3-894c-3eb688b37220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (ee3ee1ab-9a22-47a6-8f75-cd8d3cc99197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:56 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-b3d7eb7c-c34e-440e-873b-efb6506deeae tempest-ProjectReaderTests-722455128 None] Created volume successfully. Jul 23 03:36:56 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c" returned: 0 in 0.379s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:56 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc Jul 23 03:36:56 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot 01003597-1505-4086-9206-0b50f1d816fa of volume 6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbba094a-b54d-4fb3-bde5-69cef7490b18]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-892bcc28-accd-4fa2-ad26-65ee42c9e998-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "cinder-892bcc28-accd-4fa2-ad26-65ee42c9e998-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:56 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-quobyte-892bcc28-accd-4fa2-ad26-65ee42c9e998" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:56 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-892bcc28-accd-4fa2-ad26-65ee42c9e998" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:56 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc" returned: 0 in 0.424s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3786e6ce-3368-4c6c-a1ba-e8c80cede8f5]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:56 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc Jul 23 03:36:56 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:56 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 Jul 23 03:36:56 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:56 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c.61cd4e9f-0d8a-444a-951a-c6be4acb69cc" returned: 0 in 0.277s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa 1G Jul 23 03:36:57 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-61cd4e9f-0d8a-444a-951a-c6be4acb69cc" released by "_delete_snapshot" :: held 1.588s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" released by "delete_snapshot" :: held 1.629s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Created reservations ['19974a3b-0060-4b08-8fc0-31dfa7b0e815', '75da5571-f30f-4e26-a286-75d6cd5cb9ae', 'a37173d0-1536-4f76-8aa9-2d0efe695eb3', '5bd203bb-2804-470a-ade0-5040845c78e9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:57 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998" returned: 0 in 0.419s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Delete snapshot completed successfully. Jul 23 03:36:57 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998 Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9485512-ef7a-4cc5-9c67-283e9df2e238 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-61cd4e9f-0d8a-444a-951a-c6be4acb69cc-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:57 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:57 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa 1G" returned: 0 in 0.446s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f32d103-4d2b-46c6-b3a6-27351f027618 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f32d103-4d2b-46c6-b3a6-27351f027618 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa Jul 23 03:36:57 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-892bcc28-accd-4fa2-ad26-65ee42c9e998" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-892bcc28-accd-4fa2-ad26-65ee42c9e998" released by "delete_volume" :: held 0.768s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-c4c0e0e1-625f-4918-8db5-aacd216d143c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c4c0e0e1-625f-4918-8db5-aacd216d143c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Created reservations ['9468657a-3e04-4a93-b659-e29f8ceff7dc', '81421ce2-2be1-465d-966b-9f21b8428050', '9ebb4ad3-531b-4666-82be-c93dfa110126', '6b169c1d-ea36-4965-8040-dbd8fedb6ecb'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[63680a35-0b44-4a3a-94d7-d4dd63ed9c43]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:57 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:57 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c Jul 23 03:36:57 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:57 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f32d103-4d2b-46c6-b3a6-27351f027618 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa" returned: 0 in 0.396s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:57 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa is being set with open permissions: ugo+rw Jul 23 03:36:57 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:57 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa Jul 23 03:36:57 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.292s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Deleted volume successfully. Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-858a8be5-427c-4e5b-b451-f3ecce97998b tempest-ProjectReaderTests-722455128 None] Lock "cinder-892bcc28-accd-4fa2-ad26-65ee42c9e998-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:58 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c" returned: 0 in 0.443s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:58 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c Jul 23 03:36:58 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:58 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info Jul 23 03:36:58 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (63f683d5-65de-4e2d-974e-a0a03a3a6471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:58 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7af49d-2f67-4a0a-bde8-06e81c13e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-c4c0e0e1-625f-4918-8db5-aacd216d143c" returned: 0 in 0.298s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7af49d-2f67-4a0a-bde8-06e81c13e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217814768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4ab409-23e1-4f64-a8ef-fc73d914e464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:58Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36b1799-2cc6-406e-9f30-435b70354adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36b1799-2cc6-406e-9f30-435b70354adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ef369-7cfe-4c89-86ca-33b86024dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ef369-7cfe-4c89-86ca-33b86024dc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4ab409-23e1-4f64-a8ef-fc73d914e464', 'volume_name': 'volume-df4ab409-23e1-4f64-a8ef-fc73d914e464', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa23c2-54e8-440e-8475-0896c1ffa7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aa23c2-54e8-440e-8475-0896c1ffa7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99585e8-8add-40f1-ac8d-455edc4684c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:58 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Volume df4ab409-23e1-4f64-a8ef-fc73d914e464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4ab409-23e1-4f64-a8ef-fc73d914e464', 'volume_size': 1} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-quobyte-c4c0e0e1-625f-4918-8db5-aacd216d143c" released by "delete_volume" :: held 0.855s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:58 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info" returned: 0 in 0.275s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info is being set with open permissions: ugo+rw Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:58 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info Jul 23 03:36:58 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Created reservations ['ae2ab4a9-9956-4930-b2f9-6164296405f9', '8c50cfe3-9ff6-43ca-8ab6-21e77ee837b2', 'c68b6d8d-47c9-4007-a538-16ca80d9a5a1', '667bc057-91c1-44d2-9945-782e3201985e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:58 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:36:58 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.info" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217814768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4ab409-23e1-4f64-a8ef-fc73d914e464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4cb734f74d4b3986c8c199fdd48ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:58Z,use_quota=True,user_id='4dd2a2a20da340b4a80ecf5cca73a4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Creating volume df4ab409-23e1-4f64-a8ef-fc73d914e464 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:58 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:58 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 1073741824 Jul 23 03:36:58 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2336435c-10e8-4ad7-b4a5-5dc894b87315 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:36:58 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.267s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:58 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Deleted volume successfully. Jul 23 03:36:58 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c8c7842e-60c4-460a-a9c0-cb7f19535441 tempest-ProjectReaderTests-1489480249 None] Lock "cinder-c4c0e0e1-625f-4918-8db5-aacd216d143c-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:59 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 1073741824" returned: 0 in 0.538s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:59 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 Jul 23 03:36:59 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:59 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464" returned: 0 in 0.288s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99585e8-8add-40f1-ac8d-455edc4684c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4ab409-23e1-4f64-a8ef-fc73d914e464', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc844def-a465-45c0-950c-7ae9448bdb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-01003597-1505-4086-9206-0b50f1d816fa-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:59 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Volume volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 (df4ab409-23e1-4f64-a8ef-fc73d914e464): created successfully Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc844def-a465-45c0-950c-7ae9448bdb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Flow 'volume_create_manager' (63f683d5-65de-4e2d-974e-a0a03a3a6471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-01003597-1505-4086-9206-0b50f1d816fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:59 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-31403169-391d-4ebd-b88a-5bf8f306d8bf tempest-ProjectReaderTests-722455128 None] Created volume successfully. Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-01003597-1505-4086-9206-0b50f1d816fa" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-01003597-1505-4086-9206-0b50f1d816fa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot 01003597-1505-4086-9206-0b50f1d816fa of volume 6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057dbb7-de72-4ff9-b2a3-6169f00c3b36]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:59 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:00 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa Jul 23 03:37:00 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:00 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa" returned: 0 in 0.418s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f32d103-4d2b-46c6-b3a6-27351f027618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[da761892-2c51-48cb-82be-55c873bbd379]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:00 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 Jul 23 03:37:00 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-df4ab409-23e1-4f64-a8ef-fc73d914e464-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "cinder-df4ab409-23e1-4f64-a8ef-fc73d914e464-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Acquiring lock "cinder-quobyte-df4ab409-23e1-4f64-a8ef-fc73d914e464" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-df4ab409-23e1-4f64-a8ef-fc73d914e464" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cefa65-c60c-4a20-b2f4-e76d410c03fc]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:00 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:00 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618" returned: 0 in 0.456s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:00 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:00 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa Jul 23 03:37:00 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:01 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464" returned: 0 in 0.416s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:01 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464 Jul 23 03:37:01 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:01 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa" returned: 0 in 0.420s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:01 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa Jul 23 03:37:01 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:01 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-df4ab409-23e1-4f64-a8ef-fc73d914e464" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "cinder-quobyte-df4ab409-23e1-4f64-a8ef-fc73d914e464" released by "delete_volume" :: held 0.754s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Created reservations ['f91014d8-a16c-4154-9ac6-1d07748e1e19', 'add1b4f2-f12b-4af7-905d-c933e4f2e419', '7bf18152-4d50-4b67-b789-68bc111cf06a', '65813891-7c83-4e45-80e0-5b5f3067cc76'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:01 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618.01003597-1505-4086-9206-0b50f1d816fa" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:01 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:01 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-01003597-1505-4086-9206-0b50f1d816fa" released by "_delete_snapshot" :: held 1.757s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" released by "delete_snapshot" :: held 1.787s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Created reservations ['9cacfe5b-7d8a-4b1d-a197-9f938d983f73', '348a7b61-62c1-4df6-be81-7d3143bc0e4e', '34e4d3a8-2eb2-429c-ac56-7eeb3f1069a5', '2e8800ef-ef59-4b1b-bbd6-2592ab2f6054'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e9786c10-1bfc-4994-86ce-5b62693cb98f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-01003597-1505-4086-9206-0b50f1d816fa-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:01 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.330s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Deleted volume successfully. Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f5f16f14-11a9-4e52-9672-b37a99bea7eb tempest-ProjectReaderTests-722455128 None] Lock "cinder-df4ab409-23e1-4f64-a8ef-fc73d914e464-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-6f32d103-4d2b-46c6-b3a6-27351f027618-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-6f32d103-4d2b-46c6-b3a6-27351f027618-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc58da49-958e-445c-a9d6-157d4db0a152]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:02 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 Jul 23 03:37:02 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:02 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618" returned: 0 in 0.447s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:02 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618 Jul 23 03:37:02 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:02 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-6f32d103-4d2b-46c6-b3a6-27351f027618" returned: 0 in 0.307s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-6f32d103-4d2b-46c6-b3a6-27351f027618" released by "delete_volume" :: held 0.865s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Created reservations ['feeb218b-313c-495d-85fc-2c747d789c74', 'a0ec69d0-81b1-4658-a326-6da90a053b20', 'abd977d4-0e29-4be7-a02e-5007d073775c', 'b5dc4aae-07a4-4d03-b87f-b24ce34c132c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:03 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:03 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:03 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.325s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e4784b85-e257-417d-8819-bd5c682e097e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-6f32d103-4d2b-46c6-b3a6-27351f027618-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (9e77d2c1-73df-43bd-8242-592dcd69c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be12b96-fe11-4a56-a2c3-9dacc1aaaa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be12b96-fe11-4a56-a2c3-9dacc1aaaa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433471860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0efb263-7525-40e3-94de-0fd3557df00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:04Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fa956a-e2af-41c5-bec0-629c3b3c1b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fa956a-e2af-41c5-bec0-629c3b3c1b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de4b48f-8ed8-4571-90d9-617afabe5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de4b48f-8ed8-4571-90d9-617afabe5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0efb263-7525-40e3-94de-0fd3557df00c', 'volume_name': 'volume-e0efb263-7525-40e3-94de-0fd3557df00c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07113c5-d724-48cb-89bc-5d31e139c109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07113c5-d724-48cb-89bc-5d31e139c109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9809fe38-9316-4428-9fff-e17823758703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:03 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Volume e0efb263-7525-40e3-94de-0fd3557df00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0efb263-7525-40e3-94de-0fd3557df00c', 'volume_size': 1} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433471860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0efb263-7525-40e3-94de-0fd3557df00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:04Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Creating volume e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:03 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:04 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:04 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c 1073741824 Jul 23 03:37:04 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:04 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c 1073741824" returned: 0 in 0.450s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:04 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c Jul 23 03:37:04 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:04 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9809fe38-9316-4428-9fff-e17823758703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0efb263-7525-40e3-94de-0fd3557df00c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c223a09-eb0a-4a0b-8a97-b060482650b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:04 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Volume volume-e0efb263-7525-40e3-94de-0fd3557df00c (e0efb263-7525-40e3-94de-0fd3557df00c): created successfully Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c223a09-eb0a-4a0b-8a97-b060482650b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:04 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (9e77d2c1-73df-43bd-8242-592dcd69c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:04 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1c7cbefb-c7e6-4d36-b464-39c765cfc2e4 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot d5b78cc8-317b-4135-be19-df1ad146440b of volume e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbbeaaf-7c1f-42b4-a239-1179b4120727]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:06 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c Jul 23 03:37:06 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:06 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c" returned: 0 in 0.360s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:06 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b 1G Jul 23 03:37:06 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:06 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b 1G" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0efb263-7525-40e3-94de-0fd3557df00c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:06 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0efb263-7525-40e3-94de-0fd3557df00c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b Jul 23 03:37:06 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:07 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0efb263-7525-40e3-94de-0fd3557df00c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b" returned: 0 in 0.319s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:07 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b is being set with open permissions: ugo+rw Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:07 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b Jul 23 03:37:07 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:07 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b" returned: 0 in 0.232s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:07 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info Jul 23 03:37:07 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:07 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info" returned: 0 in 0.235s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:07 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info is being set with open permissions: ugo+rw Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:07 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info Jul 23 03:37:07 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:07 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.info" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-7be148a9-9093-4045-95e7-de73cd2f27f1 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-d5b78cc8-317b-4135-be19-df1ad146440b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d5b78cc8-317b-4135-be19-df1ad146440b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-d5b78cc8-317b-4135-be19-df1ad146440b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d5b78cc8-317b-4135-be19-df1ad146440b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot d5b78cc8-317b-4135-be19-df1ad146440b of volume e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944d665-be90-4152-b684-55120674efe2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:08 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b Jul 23 03:37:08 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:08 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b" returned: 0 in 0.380s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0efb263-7525-40e3-94de-0fd3557df00c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1bcb9-fbce-4d95-9771-ad151490df6a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:08 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c Jul 23 03:37:08 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:09 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c" returned: 0 in 0.374s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:09 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b Jul 23 03:37:09 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:09 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b" returned: 0 in 0.344s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:09 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b Jul 23 03:37:09 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:09 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c.d5b78cc8-317b-4135-be19-df1ad146440b" returned: 0 in 0.283s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d5b78cc8-317b-4135-be19-df1ad146440b" released by "_delete_snapshot" :: held 1.487s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" released by "delete_snapshot" :: held 1.513s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Created reservations ['5a8805bc-7832-4446-a732-85f986fc3dfb', 'd102dc0f-4b99-4fbf-9928-7eded4e5e558', 'fad0255d-5a21-4a05-955c-653bed1aa987', '60e920db-d97b-4231-bdc0-fa5e259988a8'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:09 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:09 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-0b5c4917-32e7-4c46-a300-993467eedebe tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d5b78cc8-317b-4135-be19-df1ad146440b-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-e0efb263-7525-40e3-94de-0fd3557df00c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-e0efb263-7525-40e3-94de-0fd3557df00c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" acquired by "delete_volume" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea986b25-d9ef-4636-8492-13373c4deb80]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:10 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c Jul 23 03:37:10 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:10 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:10 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c Jul 23 03:37:10 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:11 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e0efb263-7525-40e3-94de-0fd3557df00c" returned: 0 in 0.247s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e0efb263-7525-40e3-94de-0fd3557df00c" released by "delete_volume" :: held 0.728s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Created reservations ['9a80d039-4223-4b2f-9b8b-09217b29d841', '439a2a2d-9298-4762-b8fc-aed914a53646', '2042fefb-ed8f-4f3a-afe6-82306340d9f6', 'bec3593d-d3f8-419b-b882-cd98e10b1e73'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:11 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:11 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:11 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.262s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:11 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-9f59bbae-981f-4749-b35d-f75843d99d09 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-e0efb263-7525-40e3-94de-0fd3557df00c-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:11 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (a8549428-785d-4eb7-b56a-e76fe36d647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809dd420-03b7-4a49-bcf0-47d9eec93cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809dd420-03b7-4a49-bcf0-47d9eec93cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596056337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43c9c82-12a4-470d-bc0d-dfb05b48fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:12Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae9ceb-791a-40db-9aff-6854c9450601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae9ceb-791a-40db-9aff-6854c9450601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4b1c23-8eaa-4968-9f38-2d954c0e0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4b1c23-8eaa-4968-9f38-2d954c0e0858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd43c9c82-12a4-470d-bc0d-dfb05b48fd6c', 'volume_name': 'volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e113583-69d4-4264-9ddf-d185cf37fb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e113583-69d4-4264-9ddf-d185cf37fb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8641e5e-c0e2-45ff-bfbc-ce1afedf18a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Volume d43c9c82-12a4-470d-bc0d-dfb05b48fd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c', 'volume_size': 1} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596056337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43c9c82-12a4-470d-bc0d-dfb05b48fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:12Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Creating volume d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:12 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:12 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c 1073741824 Jul 23 03:37:12 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:12 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c 1073741824" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:12 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c Jul 23 03:37:12 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:12 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" returned: 0 in 0.243s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8641e5e-c0e2-45ff-bfbc-ce1afedf18a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b26529-cd77-497d-b3e1-fb99ce48ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:12 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Volume volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c (d43c9c82-12a4-470d-bc0d-dfb05b48fd6c): created successfully Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b26529-cd77-497d-b3e1-fb99ce48ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:12 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (a8549428-785d-4eb7-b56a-e76fe36d647f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-de360dd6-8fb5-4469-8afe-3c95ae583420 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot c9a44ac8-be53-48ee-af4c-857338bd9879 of volume d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[34669307-63c9-45d1-9cf1-5c7a42fbb991]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:13 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c Jul 23 03:37:13 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:13 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" returned: 0 in 0.371s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:13 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 1G Jul 23 03:37:13 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:13 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 1G" returned: 0 in 0.421s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:13 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 Jul 23 03:37:13 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:14 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879" returned: 0 in 0.304s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:14 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 is being set with open permissions: ugo+rw Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:14 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 Jul 23 03:37:14 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:14 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:14 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info Jul 23 03:37:14 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:14 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:14 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info is being set with open permissions: ugo+rw Jul 23 03:37:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:14 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info Jul 23 03:37:14 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:15 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.info" returned: 0 in 0.236s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-019f5552-28cc-4280-a910-44f7111e4aa8 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-c9a44ac8-be53-48ee-af4c-857338bd9879-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c9a44ac8-be53-48ee-af4c-857338bd9879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-c9a44ac8-be53-48ee-af4c-857338bd9879" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c9a44ac8-be53-48ee-af4c-857338bd9879" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot c9a44ac8-be53-48ee-af4c-857338bd9879 of volume d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f50c66-a0e8-4d41-8ef1-448a42ce81df]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:15 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 Jul 23 03:37:15 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:15 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c67d8-e228-46f3-b90b-c29402d26b8d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:15 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c Jul 23 03:37:15 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" returned: 0 in 0.394s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:16 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 Jul 23 03:37:16 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:16 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879 Jul 23 03:37:16 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:16 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c.c9a44ac8-be53-48ee-af4c-857338bd9879" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c9a44ac8-be53-48ee-af4c-857338bd9879" released by "_delete_snapshot" :: held 1.536s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" released by "delete_snapshot" :: held 1.559s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Created reservations ['147d7192-16f6-4c66-bd0a-0b83cd8b2d8c', 'c5ca93c1-202a-49a2-8392-81989e6ab195', 'db0513e9-2500-4aa1-a352-4532bd3600c4', '874fe483-a8c6-4ba6-a66c-9a0cdc0ec4e7'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:16 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-54503f38-0e49-4faa-88b7-687fa437889b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c9a44ac8-be53-48ee-af4c-857338bd9879-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" acquired by "delete_volume" :: waited 0.021s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[326a97cb-2433-424d-a06f-a72aeacbd1a1]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:17 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c Jul 23 03:37:17 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:17 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" returned: 0 in 0.392s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:18 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c Jul 23 03:37:18 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:18 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" returned: 0 in 0.266s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c" released by "delete_volume" :: held 0.735s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Created reservations ['ada58088-c45a-4b2a-8615-b2792f0b67de', '362d1997-f053-407d-9cfc-8290d8c68ffa', '1e39bbb3-b910-4378-a99c-25ace2b3fcc7', 'a165b4f2-18ae-4915-8883-e1af95f6b002'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:18 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:18 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:18 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.279s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:18 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:18 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-1a07e5cd-e578-43cb-8291-94f1e4527dec tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d43c9c82-12a4-470d-bc0d-dfb05b48fd6c-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (cddfc066-a09b-4a09-8e8b-5284eee5284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d511ddf6-b76a-49ed-ad19-3175749495b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d511ddf6-b76a-49ed-ad19-3175749495b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163264908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712ca5e3-c11f-419a-ac15-8305e7dd33d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:19Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc726fba-7f4d-4efa-a8e8-20dad0cc6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc726fba-7f4d-4efa-a8e8-20dad0cc6df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3b070-7b2f-46ec-aac5-4ab39771eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3b070-7b2f-46ec-aac5-4ab39771eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712ca5e3-c11f-419a-ac15-8305e7dd33d2', 'volume_name': 'volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f5b30b-4298-4e67-9f39-af59f02bdb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f5b30b-4298-4e67-9f39-af59f02bdb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e27e22c-7ac2-4d41-b533-09634498306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Volume 712ca5e3-c11f-419a-ac15-8305e7dd33d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2', 'volume_size': 1} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163264908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712ca5e3-c11f-419a-ac15-8305e7dd33d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:19Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Creating volume 712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:19 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:19 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 1073741824 Jul 23 03:37:19 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Flow 'volume_create_manager' (04c47ce0-1250-426c-b7b2-f81c35c1d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c223f1-010c-4a7b-98d4-9b22827680d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 1073741824" returned: 0 in 0.480s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c223f1-010c-4a7b-98d4-9b22827680d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325559885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d5db42-f50e-489f-8efb-1e72e2c72378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6afe8930d144a88f9cc491a57c8725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:20Z,use_quota=True,user_id='aa2a6f3127604597a7e826e751b22932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aafe967-10fc-4878-80c6-64bd87c413f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aafe967-10fc-4878-80c6-64bd87c413f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5837dc7d-7a9b-4af3-84f1-d82453ece42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5837dc7d-7a9b-4af3-84f1-d82453ece42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d5db42-f50e-489f-8efb-1e72e2c72378', 'volume_name': 'volume-39d5db42-f50e-489f-8efb-1e72e2c72378', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb334d5-a7f4-4979-a105-579aef655102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb334d5-a7f4-4979-a105-579aef655102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8c1980-e1f1-4caf-9481-0df49114c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:19 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Volume 39d5db42-f50e-489f-8efb-1e72e2c72378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d5db42-f50e-489f-8efb-1e72e2c72378', 'volume_size': 1} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:19 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:19 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 Jul 23 03:37:19 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:20 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325559885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d5db42-f50e-489f-8efb-1e72e2c72378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6afe8930d144a88f9cc491a57c8725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:20Z,use_quota=True,user_id='aa2a6f3127604597a7e826e751b22932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Creating volume 39d5db42-f50e-489f-8efb-1e72e2c72378 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:20 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e27e22c-7ac2-4d41-b533-09634498306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:20 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 1073741824 Jul 23 03:37:20 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6627ac-bfd6-4a19-bae6-f74652e5f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Volume volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 (712ca5e3-c11f-419a-ac15-8305e7dd33d2): created successfully Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6627ac-bfd6-4a19-bae6-f74652e5f609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (cddfc066-a09b-4a09-8e8b-5284eee5284e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-3826aaf6-dd92-442d-9a5a-5d3e3d1806c3 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:20 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 1073741824" returned: 0 in 0.422s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:20 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 Jul 23 03:37:20 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:20 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378" returned: 0 in 0.241s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8c1980-e1f1-4caf-9481-0df49114c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d5db42-f50e-489f-8efb-1e72e2c72378', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd645e9-30fb-4116-a1ee-e43471ee621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:20 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Volume volume-39d5db42-f50e-489f-8efb-1e72e2c72378 (39d5db42-f50e-489f-8efb-1e72e2c72378): created successfully Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd645e9-30fb-4116-a1ee-e43471ee621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:20 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Flow 'volume_create_manager' (04c47ce0-1250-426c-b7b2-f81c35c1d847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:20 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6333c65d-db03-4e0f-83f3-1729ee806e78 tempest-ProjectReaderTests-2091588734 None] Created volume successfully. Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot c98f00eb-345c-429e-8f1b-d71d42789242 of volume 712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f554fa-80dc-493c-b6c9-cb8aebd000bd]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:21 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 Jul 23 03:37:21 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:21 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2" returned: 0 in 0.349s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:21 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 1G Jul 23 03:37:21 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Acquiring lock "cinder-39d5db42-f50e-489f-8efb-1e72e2c72378-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "cinder-39d5db42-f50e-489f-8efb-1e72e2c72378-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Acquiring lock "cinder-quobyte-39d5db42-f50e-489f-8efb-1e72e2c72378" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "cinder-quobyte-39d5db42-f50e-489f-8efb-1e72e2c72378" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4650f59-b806-469a-8de8-4b86500a9436]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:21 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 Jul 23 03:37:22 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:22 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 1G" returned: 0 in 0.445s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 Jul 23 03:37:22 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:22 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378" returned: 0 in 0.404s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378 Jul 23 03:37:22 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:22 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242" returned: 0 in 0.294s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:22 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 is being set with open permissions: ugo+rw Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 Jul 23 03:37:22 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:22 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-39d5db42-f50e-489f-8efb-1e72e2c72378" returned: 0 in 0.251s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "cinder-quobyte-39d5db42-f50e-489f-8efb-1e72e2c72378" released by "delete_volume" :: held 0.705s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Created reservations ['b9842deb-b541-4c5b-b319-1da1def82176', 'aa753639-d3bc-40a7-8cad-d7ced0516ff5', '22c9e615-9a37-4e4b-b902-b2ed020e54bc', '5f29382f-e294-4d67-87c3-de3f9191ecdf'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:22 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:22 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:22 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:22 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info Jul 23 03:37:22 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:23 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.262s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Deleted volume successfully. Jul 23 03:37:23 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:23 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info is being set with open permissions: ugo+rw Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:23 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info Jul 23 03:37:23 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26e69f82-7908-41a4-8da7-2b85624ace5f tempest-ProjectReaderTests-2091588734 None] Lock "cinder-39d5db42-f50e-489f-8efb-1e72e2c72378-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:23 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.info" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:23 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-cb0d04ad-ff79-4974-96bf-563e3f6500d9 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Flow 'volume_create_manager' (d8b5b25d-6181-42d3-94ba-29fe11f29608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59df8f-23d5-4145-9e0b-2b51448ee57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee59df8f-23d5-4145-9e0b-2b51448ee57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139590627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92876f09-b21b-4eb0-8757-ead66d643d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6afe8930d144a88f9cc491a57c8725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:23Z,use_quota=True,user_id='aa2a6f3127604597a7e826e751b22932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7502e87a-6a0d-47db-aa7b-5fbbce109a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7502e87a-6a0d-47db-aa7b-5fbbce109a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf6ef31-e2cb-4908-a38b-e0d3c9d8475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf6ef31-e2cb-4908-a38b-e0d3c9d8475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92876f09-b21b-4eb0-8757-ead66d643d6a', 'volume_name': 'volume-92876f09-b21b-4eb0-8757-ead66d643d6a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451181bd-7ad0-448c-a65c-311bc1ed9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451181bd-7ad0-448c-a65c-311bc1ed9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f787d6b6-ad6b-4717-be29-2217cc886094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:23 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Volume 92876f09-b21b-4eb0-8757-ead66d643d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92876f09-b21b-4eb0-8757-ead66d643d6a', 'volume_size': 1} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139590627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92876f09-b21b-4eb0-8757-ead66d643d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb6afe8930d144a88f9cc491a57c8725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:23Z,use_quota=True,user_id='aa2a6f3127604597a7e826e751b22932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Creating volume 92876f09-b21b-4eb0-8757-ead66d643d6a {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:23 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:23 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a 1073741824 Jul 23 03:37:23 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:23 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a 1073741824" returned: 0 in 0.398s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:23 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:23 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a Jul 23 03:37:23 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:24 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f787d6b6-ad6b-4717-be29-2217cc886094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92876f09-b21b-4eb0-8757-ead66d643d6a', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf6ceec-93d2-468d-9e77-83a52c723658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:24 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Volume volume-92876f09-b21b-4eb0-8757-ead66d643d6a (92876f09-b21b-4eb0-8757-ead66d643d6a): created successfully Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf6ceec-93d2-468d-9e77-83a52c723658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Flow 'volume_create_manager' (d8b5b25d-6181-42d3-94ba-29fe11f29608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:24 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c7ea9b66-8ae3-49aa-9a54-d9113dc64bec tempest-ProjectReaderTests-2091588734 None] Created volume successfully. Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-c98f00eb-345c-429e-8f1b-d71d42789242-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Acquiring lock "cinder-92876f09-b21b-4eb0-8757-ead66d643d6a-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "cinder-92876f09-b21b-4eb0-8757-ead66d643d6a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c98f00eb-345c-429e-8f1b-d71d42789242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-c98f00eb-345c-429e-8f1b-d71d42789242" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c98f00eb-345c-429e-8f1b-d71d42789242" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot c98f00eb-345c-429e-8f1b-d71d42789242 of volume 712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[444360c0-f19c-4da5-ba94-54b4c973c8b7]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Acquiring lock "cinder-quobyte-92876f09-b21b-4eb0-8757-ead66d643d6a" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "cinder-quobyte-92876f09-b21b-4eb0-8757-ead66d643d6a" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[81847f65-e355-439e-a17c-9c234ec1f8a8]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:24 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:24 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 Jul 23 03:37:24 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:24 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a Jul 23 03:37:24 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:25 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242" returned: 0 in 0.394s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018cff2-fa07-49cd-9345-ce99373a77f2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:25 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a" returned: 0 in 0.367s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:25 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a Jul 23 03:37:25 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:25 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 Jul 23 03:37:25 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:25 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-92876f09-b21b-4eb0-8757-ead66d643d6a" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "cinder-quobyte-92876f09-b21b-4eb0-8757-ead66d643d6a" released by "delete_volume" :: held 0.668s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Created reservations ['3ab1a886-63cb-4b8d-a11e-cc7f57555105', '2ca5e4ca-0623-475e-8f5c-8f89f9208082', '6b454120-9919-4a92-9afa-e73fdd16fc4b', '4314978b-a345-4c36-a3b3-f3e3638a6087'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:25 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2" returned: 0 in 0.389s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:25 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 Jul 23 03:37:25 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:25 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:25 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:25 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.282s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:25 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Deleted volume successfully. Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f3150061-0a60-4a03-9f3a-18f567b44285 tempest-ProjectReaderTests-2091588734 None] Lock "cinder-92876f09-b21b-4eb0-8757-ead66d643d6a-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:25 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242" returned: 0 in 0.420s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:25 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:25 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242 Jul 23 03:37:25 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:26 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2.c98f00eb-345c-429e-8f1b-d71d42789242" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c98f00eb-345c-429e-8f1b-d71d42789242" released by "_delete_snapshot" :: held 1.587s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" released by "delete_snapshot" :: held 1.619s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Created reservations ['f4715b15-75c1-4157-bfe7-3510a2b57a49', 'abae476a-82f0-4436-8819-5e70372c9366', '32e10845-aa73-4e33-9200-8cb20ff29cf6', 'ddc154a8-e94d-4a6c-9813-c252653a3311'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:26 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-e7b5e249-ee85-442e-87e3-b01b2b43ab4a tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c98f00eb-345c-429e-8f1b-d71d42789242-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-712ca5e3-c11f-419a-ac15-8305e7dd33d2-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-712ca5e3-c11f-419a-ac15-8305e7dd33d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23dd3b-09e9-4004-a086-8cc0e3258102]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:26 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:26 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 Jul 23 03:37:26 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:27 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:27 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2 Jul 23 03:37:27 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:27 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-712ca5e3-c11f-419a-ac15-8305e7dd33d2" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-712ca5e3-c11f-419a-ac15-8305e7dd33d2" released by "delete_volume" :: held 0.720s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Created reservations ['8436659f-7c2b-4627-99c5-91fcc5349265', 'ab8fa52e-3563-447f-baa4-b0e0784b37c1', 'd5524484-8099-4755-b4e8-1d4a09ebb9cc', '7543a0b1-4a4c-45f9-bacd-a535a349c29e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:27 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:27 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:27 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.268s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:27 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:27 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-f0f421a0-4f52-42ce-8b2e-9b50b9f83475 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-712ca5e3-c11f-419a-ac15-8305e7dd33d2-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (ea90072e-3279-4d8a-9a51-121e0d55b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550870ba-16a2-495b-85c8-b50d2cacc8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550870ba-16a2-495b-85c8-b50d2cacc8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191973467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3076bfdc-6e20-40f8-9718-e93145e2ce09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f662648-40a9-4252-9f69-95a9192762d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f662648-40a9-4252-9f69-95a9192762d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20162a2-d710-4f8a-8680-3beb9369ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20162a2-d710-4f8a-8680-3beb9369ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3076bfdc-6e20-40f8-9718-e93145e2ce09', 'volume_name': 'volume-3076bfdc-6e20-40f8-9718-e93145e2ce09', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e2b066-0f1a-43c2-af0c-b3b52136a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e2b066-0f1a-43c2-af0c-b3b52136a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6f3b5-aa81-44ba-af93-c0b3a9e913a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:28 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Volume 3076bfdc-6e20-40f8-9718-e93145e2ce09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3076bfdc-6e20-40f8-9718-e93145e2ce09', 'volume_size': 1} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191973467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3076bfdc-6e20-40f8-9718-e93145e2ce09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:28Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Creating volume 3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:28 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:28 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 1073741824 Jul 23 03:37:28 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:28 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 1073741824" returned: 0 in 0.455s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:28 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:29 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 Jul 23 03:37:29 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:29 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09" returned: 0 in 0.243s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6f3b5-aa81-44ba-af93-c0b3a9e913a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3076bfdc-6e20-40f8-9718-e93145e2ce09', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ef0a8-9101-438c-82c9-3cb57d8cd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:29 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Volume volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 (3076bfdc-6e20-40f8-9718-e93145e2ce09): created successfully Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3ef0a8-9101-438c-82c9-3cb57d8cd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (ea90072e-3279-4d8a-9a51-121e0d55b110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=174,cinder:INSERT=70,cinder:UPDATE=235,cinder:DELETE=18 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:29 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-479edf60-e571-4230-ab2a-50663fd89422 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:INSERT=54,cinder:UPDATE=240,cinder:SELECT=179,cinder:DELETE=22 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot f13e2dff-bd78-4e75-af8e-7fec9508658f of volume 3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e51ff6-d42e-48fb-825c-1b2d3e89d54d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:29 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:29 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 Jul 23 03:37:29 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:30 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:30 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f 1G Jul 23 03:37:30 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:30 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f 1G" returned: 0 in 0.431s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:30 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f Jul 23 03:37:30 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:30 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f" returned: 0 in 0.311s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:30 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f is being set with open permissions: ugo+rw Jul 23 03:37:30 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:30 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f Jul 23 03:37:30 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:31 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f" returned: 0 in 0.262s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:31 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info Jul 23 03:37:31 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:31 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:31 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info is being set with open permissions: ugo+rw Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:31 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info Jul 23 03:37:31 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:31 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.info" returned: 0 in 0.269s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:31 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:31 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6ec95f6a-b664-4efc-ae48-41e8378bab13 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-f13e2dff-bd78-4e75-af8e-7fec9508658f-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-f13e2dff-bd78-4e75-af8e-7fec9508658f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-f13e2dff-bd78-4e75-af8e-7fec9508658f" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-f13e2dff-bd78-4e75-af8e-7fec9508658f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot f13e2dff-bd78-4e75-af8e-7fec9508658f of volume 3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a605d7d-4978-4be6-af3c-d86cd4f1f3b2]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:32 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f Jul 23 03:37:33 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:33 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f" returned: 0 in 0.376s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3076bfdc-6e20-40f8-9718-e93145e2ce09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e320c-5584-498e-a6e2-7d6383fa726a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 Jul 23 03:37:33 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:33 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09" returned: 0 in 0.383s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:33 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:33 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f Jul 23 03:37:33 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:34 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f" returned: 0 in 0.359s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:34 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f Jul 23 03:37:34 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:34 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09.f13e2dff-bd78-4e75-af8e-7fec9508658f" returned: 0 in 0.240s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-f13e2dff-bd78-4e75-af8e-7fec9508658f" released by "_delete_snapshot" :: held 1.468s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" released by "delete_snapshot" :: held 1.489s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Created reservations ['f89f1625-bfc2-4112-83bd-07b6c66521c1', 'a9115a73-c38a-4914-8780-b2a23d7c4d48', 'e0373402-6ba1-4c6a-8aa8-26c4926d12ca', 'a8c52a4c-c35b-4d2e-ab04-ee0939ccad85'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:34 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:34 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fd24a7e3-db06-4175-9c6f-574271f4b0be tempest-ProjectMemberTests-1876011461 None] Lock "cinder-f13e2dff-bd78-4e75-af8e-7fec9508658f-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-3076bfdc-6e20-40f8-9718-e93145e2ce09-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-3076bfdc-6e20-40f8-9718-e93145e2ce09-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" acquired by "delete_volume" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a9f76-fdb2-4069-bd1b-3ef8f2dc3fad]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 Jul 23 03:37:35 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:35 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09" returned: 0 in 0.377s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09 Jul 23 03:37:35 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:35 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3076bfdc-6e20-40f8-9718-e93145e2ce09" returned: 0 in 0.242s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3076bfdc-6e20-40f8-9718-e93145e2ce09" released by "delete_volume" :: held 0.677s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Created reservations ['3f37ca55-d837-4a13-88c6-69aa82596743', '4b61b64f-5002-4a19-b72b-dc2e004752ab', '31bd7fdf-2206-44a5-98c4-707a5c55603f', '31cdba08-c16e-491a-839d-4a0d8b082df0'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:35 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:35 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:35 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:36 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.322s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:36 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-ce9159cf-0475-4031-9cca-096ae26a9da3 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-3076bfdc-6e20-40f8-9718-e93145e2ce09-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (54efa9a3-0898-4d64-91a4-5603d39a139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e3264d-7506-40d2-95e9-192aebe4b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e3264d-7506-40d2-95e9-192aebe4b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996241832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:37Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a35bcfb-60b7-43e6-a68a-81ebb3e025a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a35bcfb-60b7-43e6-a68a-81ebb3e025a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f064a7-e1de-417d-ac6c-382b2d8e7312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f064a7-e1de-417d-ac6c-382b2d8e7312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0', 'volume_name': 'volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c622f74c-d8a0-488b-95b8-90dc44156375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c622f74c-d8a0-488b-95b8-90dc44156375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f90c5-90bd-4ae8-8007-8fa4f0cf3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:36 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Volume e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0', 'volume_size': 1} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996241832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:37Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Creating volume e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:36 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:36 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:36 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 1073741824 Jul 23 03:37:36 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 1073741824" returned: 0 in 0.602s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:37 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:37 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 Jul 23 03:37:37 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:37 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" returned: 0 in 0.361s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f90c5-90bd-4ae8-8007-8fa4f0cf3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160a5893-da4c-458a-836a-1c656c8729fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:37 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Volume volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 (e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0): created successfully Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160a5893-da4c-458a-836a-1c656c8729fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:37 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (54efa9a3-0898-4d64-91a4-5603d39a139a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:38 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-796f9498-b6a9-4f1c-9634-93a972746583 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot d1dfcf1c-2b31-4043-a213-f8000f3fab2b of volume e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75c509-f901-43fb-bab2-2cfaa2527821]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:39 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 Jul 23 03:37:39 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:39 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:39 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b 1G Jul 23 03:37:39 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:39 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b 1G" returned: 0 in 0.448s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:39 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:39 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b Jul 23 03:37:39 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:40 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b" returned: 0 in 0.297s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b is being set with open permissions: ugo+rw Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:40 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b Jul 23 03:37:40 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:40 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b" returned: 0 in 0.278s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:40 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info Jul 23 03:37:40 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:40 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info" returned: 0 in 0.286s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:40 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info is being set with open permissions: ugo+rw Jul 23 03:37:40 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:40 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info Jul 23 03:37:40 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:41 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.info" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:41 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:41 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-41f69260-ad0c-4892-bdbe-723943000bb7 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-d1dfcf1c-2b31-4043-a213-f8000f3fab2b-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d1dfcf1c-2b31-4043-a213-f8000f3fab2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-d1dfcf1c-2b31-4043-a213-f8000f3fab2b" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d1dfcf1c-2b31-4043-a213-f8000f3fab2b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot d1dfcf1c-2b31-4043-a213-f8000f3fab2b of volume e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b86d5-99b0-46cb-be64-7537581cb604]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:42 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b Jul 23 03:37:42 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:42 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b" returned: 0 in 0.375s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afff4bc-aeb4-4ccc-9ed8-ff1c83ff2e9d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:42 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:42 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 Jul 23 03:37:42 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:43 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" returned: 0 in 0.384s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:43 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b Jul 23 03:37:43 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:43 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b" returned: 0 in 0.529s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:43 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b Jul 23 03:37:43 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:43 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0.d1dfcf1c-2b31-4043-a213-f8000f3fab2b" returned: 0 in 0.274s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-d1dfcf1c-2b31-4043-a213-f8000f3fab2b" released by "_delete_snapshot" :: held 1.663s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" released by "delete_snapshot" :: held 1.686s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:43 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Created reservations ['ff1f5557-675c-4733-bb5e-5d05db325990', '9692fdd6-8ac0-4c35-9631-f264d3e914b4', 'f2cbdedd-9e73-4c69-a17d-df6c5c6ce839', '9af5eb70-f8ff-44c2-9d2b-119d0a7cb367'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:44 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-24c641d1-56e9-4dfc-963a-299c4930f145 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-d1dfcf1c-2b31-4043-a213-f8000f3fab2b-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1ece7f-9c54-481c-84eb-96746fb2f16d]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:44 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 Jul 23 03:37:44 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:44 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" returned: 0 in 0.407s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:44 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:45 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0 Jul 23 03:37:45 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:45 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" returned: 0 in 0.280s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0" released by "delete_volume" :: held 0.753s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Created reservations ['1040a582-e8ad-43ed-ac4e-3729c05bf491', '98f26d27-442f-4506-93ab-55a79c0e9e51', 'b6757266-f1ce-4378-9ec3-e80d54a96c16', 'dce4e598-5666-4276-a4d5-230d9501332e'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:45 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:45 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:45 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.359s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:45 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:45 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-26bdd2cd-8af1-4c9d-9e8a-a553fb34686e tempest-ProjectMemberTests-1876011461 None] Lock "cinder-e7d1e17c-f1aa-4f5b-aef0-92cd05ccf9f0-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (a8e84731-8813-4a90-ad7f-4f397489b661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a88d35b-7faf-4e31-bd8c-dd1419e3a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a88d35b-7faf-4e31-bd8c-dd1419e3a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420112951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0cdd41-eb4b-4beb-928e-7792a29dc347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:46Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5f6539-316a-4883-b1f4-c24cbcddcddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5f6539-316a-4883-b1f4-c24cbcddcddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4f27a-6bc1-429d-80b3-59d071e58f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4f27a-6bc1-429d-80b3-59d071e58f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0cdd41-eb4b-4beb-928e-7792a29dc347', 'volume_name': 'volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c036a-56ce-4252-9a47-6bc39c9faa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c036a-56ce-4252-9a47-6bc39c9faa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6a7c5-99b9-4eec-85f9-579e1581df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:46 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Volume 5d0cdd41-eb4b-4beb-928e-7792a29dc347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347', 'volume_size': 1} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420112951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0cdd41-eb4b-4beb-928e-7792a29dc347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:46Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Creating volume 5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:46 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:46 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 1073741824 Jul 23 03:37:46 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:46 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 1073741824" returned: 0 in 0.475s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:46 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:46 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 Jul 23 03:37:46 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:47 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347" returned: 0 in 0.258s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6a7c5-99b9-4eec-85f9-579e1581df28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a96c9-88b6-47fc-a786-238f0f897228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:47 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Volume volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 (5d0cdd41-eb4b-4beb-928e-7792a29dc347): created successfully Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a96c9-88b6-47fc-a786-238f0f897228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (a8e84731-8813-4a90-ad7f-4f397489b661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:47 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-a2e118ca-177d-434a-914f-e3f6915556e9 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:47 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:47 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:47 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:48 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.281s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_service.periodic_task [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread count: 28 {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-9dbd3657-7c4c-4107-ba55-e3b9a1bd07b9 None None] thread info: [<_MainThread(MainThread, started 132505194639488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot dbfc5c1b-efcd-4722-b491-2fda3a02242d of volume 5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0176a4-adcb-472a-9fa8-eed0f86e794e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:48 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 Jul 23 03:37:48 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:48 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347" returned: 0 in 0.402s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:48 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:49 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d 1G Jul 23 03:37:49 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:49 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d 1G" returned: 0 in 0.430s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:49 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d Jul 23 03:37:49 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Flow 'volume_create_manager' (542af3c6-a07f-4c5e-9252-cfcf2ce8779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35de46af-5076-4f00-9f9e-51dc01cc1e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35de46af-5076-4f00-9f9e-51dc01cc1e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-625138367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd69b85a-4930-4831-8ab8-c076b608088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d2f3ba46dd403bb94c2bf82a9ce7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:49Z,use_quota=True,user_id='deb223c8b2284c6188b3e4b373332a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1074fb55-c329-4e74-b891-9ccc381ee80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1074fb55-c329-4e74-b891-9ccc381ee80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed70c356-eb86-4ede-bfa0-65dd5867ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed70c356-eb86-4ede-bfa0-65dd5867ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd69b85a-4930-4831-8ab8-c076b608088f', 'volume_name': 'volume-dd69b85a-4930-4831-8ab8-c076b608088f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6697bbe-1eef-48f9-ba22-ba327a453715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6697bbe-1eef-48f9-ba22-ba327a453715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7f36b-2f8b-429c-a1de-30eabd67509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:49 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Volume dd69b85a-4930-4831-8ab8-c076b608088f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd69b85a-4930-4831-8ab8-c076b608088f', 'volume_size': 1} Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:49 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d" returned: 0 in 0.303s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:49 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d is being set with open permissions: ugo+rw Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:49 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d Jul 23 03:37:49 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:49 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:49 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d" returned: 0 in 0.253s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info Jul 23 03:37:50 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:50 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:50 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info is being set with open permissions: ugo+rw Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info Jul 23 03:37:50 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:50 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.info" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-625138367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd69b85a-4930-4831-8ab8-c076b608088f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d2f3ba46dd403bb94c2bf82a9ce7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:49Z,use_quota=True,user_id='deb223c8b2284c6188b3e4b373332a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Creating volume dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:50 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f 1073741824 Jul 23 03:37:50 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:50 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-f979634f-7116-4138-94e5-1d89a61e9427 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-dbfc5c1b-efcd-4722-b491-2fda3a02242d-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-dbfc5c1b-efcd-4722-b491-2fda3a02242d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-dbfc5c1b-efcd-4722-b491-2fda3a02242d" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-dbfc5c1b-efcd-4722-b491-2fda3a02242d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot dbfc5c1b-efcd-4722-b491-2fda3a02242d of volume 5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d18f3-739f-4d82-9837-44bdda157b5c]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:50 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d Jul 23 03:37:50 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:50 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:50 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f 1073741824" returned: 0 in 0.439s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:37:51 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86b78c1-e998-434a-a4b6-16156eac8fcb]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.255s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7f36b-2f8b-429c-a1de-30eabd67509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd69b85a-4930-4831-8ab8-c076b608088f', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524e39e-44e4-4574-928a-d2608c4af6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:51 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Volume volume-dd69b85a-4930-4831-8ab8-c076b608088f (dd69b85a-4930-4831-8ab8-c076b608088f): created successfully Jul 23 03:37:51 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 Jul 23 03:37:51 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524e39e-44e4-4574-928a-d2608c4af6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Flow 'volume_create_manager' (542af3c6-a07f-4c5e-9252-cfcf2ce8779c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:51 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-dff36d74-3f9a-482a-a044-b7fd797540ec tempest-SnapshotDependencyTests-927196718 None] Created volume successfully. Jul 23 03:37:51 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347" returned: 0 in 0.374s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d Jul 23 03:37:51 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Creating offline snapshot a513d60f-f9e8-4cbc-8636-80ced1a71972 of volume dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7919d56-6530-41d2-892e-0d3746935f80]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d" returned: 0 in 0.363s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:51 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:51 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:37:51 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:51 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d Jul 23 03:37:51 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347.dbfc5c1b-efcd-4722-b491-2fda3a02242d" returned: 0 in 0.256s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.381s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-dbfc5c1b-efcd-4722-b491-2fda3a02242d" released by "_delete_snapshot" :: held 1.471s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" released by "delete_snapshot" :: held 1.495s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:52 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 1G Jul 23 03:37:52 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Created reservations ['dc6725ec-8807-49cc-9f72-c1fdba9dc62d', '81150aee-2727-4716-b944-0d6c695cc77a', '7d2edfaa-4c34-4429-bb31-bb9e34b5eb2f', '31009805-f5a2-45ef-9310-a09ebb6c67d9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:52 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-38c0b4bb-d360-4c08-ad95-4c9b6263215f tempest-ProjectMemberTests-1876011461 None] Lock "cinder-dbfc5c1b-efcd-4722-b491-2fda3a02242d-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:52 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 1G" returned: 0 in 0.395s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd69b85a-4930-4831-8ab8-c076b608088f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd69b85a-4930-4831-8ab8-c076b608088f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:37:52 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-5d0cdd41-eb4b-4beb-928e-7792a29dc347-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-5d0cdd41-eb4b-4beb-928e-7792a29dc347-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:52 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd69b85a-4930-4831-8ab8-c076b608088f -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.339s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:52 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 is being set with open permissions: ugo+rw Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:52 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:52 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:37:52 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ac828-a4c3-455e-87c8-bc06bb299a4a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 Jul 23 03:37:53 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info Jul 23 03:37:53 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347" returned: 0 in 0.383s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347 Jul 23 03:37:53 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info" returned: 0 in 0.284s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info is being set with open permissions: ugo+rw Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info Jul 23 03:37:53 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:53 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-5d0cdd41-eb4b-4beb-928e-7792a29dc347" returned: 0 in 0.285s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-5d0cdd41-eb4b-4beb-928e-7792a29dc347" released by "delete_volume" :: held 0.745s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Created reservations ['f8e8bea6-aecb-4988-90b9-c8b50c6f76bf', '7b5b968c-1819-4223-8eea-1b62715cc117', '2b3235a1-7158-45dc-b82a-41e98e1bd383', '89db953f-80ca-4dd1-b822-a19505b371b9'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:37:53 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.info" returned: 0 in 0.260s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:53 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-23cba610-695c-4350-9bf4-be5071fd2bb3 tempest-SnapshotDependencyTests-927196718 None] Create snapshot completed successfully Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:53 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:53 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:37:53 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:54 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:54 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5890caf0-995a-4251-b65e-8ef3b2d29bd5 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-5d0cdd41-eb4b-4beb-928e-7792a29dc347-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (b8845f65-9e8f-4c26-a29a-bea21561a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a32e27-c643-4994-a008-2d8de7aa999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a32e27-c643-4994-a008-2d8de7aa999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317605234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9e510a-d68d-457f-b0a6-b669e2b87d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:54Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dd17cb-f509-40dd-ba7f-7dd4d38fbadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dd17cb-f509-40dd-ba7f-7dd4d38fbadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ead5039-e5f0-4fb0-9c65-8220cd361c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ead5039-e5f0-4fb0-9c65-8220cd361c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9e510a-d68d-457f-b0a6-b669e2b87d09', 'volume_name': 'volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc84d8f-5ca6-49a8-a5aa-325729bfd14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc84d8f-5ca6-49a8-a5aa-325729bfd14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483e3411-bb5c-47ae-a8d9-c947bbdef58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:54 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Volume 3f9e510a-d68d-457f-b0a6-b669e2b87d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09', 'volume_size': 1} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317605234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9e510a-d68d-457f-b0a6-b669e2b87d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:54Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Creating volume 3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:54 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:37:54 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:54 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 1073741824 Jul 23 03:37:54 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:55 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 1073741824" returned: 0 in 0.442s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:55 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 Jul 23 03:37:55 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:55 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483e3411-bb5c-47ae-a8d9-c947bbdef58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1e896-c019-49ed-873f-7477734e92bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Volume volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 (3f9e510a-d68d-457f-b0a6-b669e2b87d09): created successfully Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d1e896-c019-49ed-873f-7477734e92bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (b8845f65-9e8f-4c26-a29a-bea21561a699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:55 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-85868fbc-37ad-4265-ad66-8ff02e9e2ba3 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Flow 'volume_create_manager' (3cdd02da-eb37-4f5d-8c0a-6342155f5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbeb54a-8db4-4ff6-ab32-c3a3effa0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbeb54a-8db4-4ff6-ab32-c3a3effa0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7eade92-fe29-45d1-a164-40f1ed57a5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d2f3ba46dd403bb94c2bf82a9ce7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a513d60f-f9e8-4cbc-8636-80ced1a71972,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:37:56Z,use_quota=True,user_id='deb223c8b2284c6188b3e4b373332a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73808ef-90a0-4db0-b40b-6912ea55f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73808ef-90a0-4db0-b40b-6912ea55f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fa29bd-dee5-4df3-b2ce-d62fab206e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fa29bd-dee5-4df3-b2ce-d62fab206e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7eade92-fe29-45d1-a164-40f1ed57a5cc', 'volume_name': 'volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc', 'volume_size': 1, 'snapshot_id': 'a513d60f-f9e8-4cbc-8636-80ced1a71972'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1ef9b2-41ff-46f0-b74b-7e78116a0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1ef9b2-41ff-46f0-b74b-7e78116a0651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67a3fb2-223f-426d-a51c-e1f5b813e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:37:55 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Volume e7eade92-fe29-45d1-a164-40f1ed57a5cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc', 'volume_size': 1, 'snapshot_id': 'a513d60f-f9e8-4cbc-8636-80ced1a71972'} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972-e7eade92-fe29-45d1-a164-40f1ed57a5cc" by "_create_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972-e7eade92-fe29-45d1-a164-40f1ed57a5cc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Creating volume e7eade92-fe29-45d1-a164-40f1ed57a5cc from snapshot a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" by "_copy_volume_from_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] snapshot: a513d60f-f9e8-4cbc-8636-80ced1a71972, volume: e7eade92-fe29-45d1-a164-40f1ed57a5cc, {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bc88fe-c15e-4bb3-8cd6-d2a3e2cb3140]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:55 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:55 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:37:55 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:56 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.352s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd69b85a-4930-4831-8ab8-c076b608088f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Creating direct copy from snapshot {{(pid=88466) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[17192b0a-457f-4fa5-9044-887ffddb2d78]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:56 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:37:56 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:56 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG cinder.utils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Path /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc not found in is_blk_device check {{(pid=88466) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:37:56 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:56 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc Jul 23 03:37:56 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:00 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc" returned: 0 in 4.103s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:00 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b09fb8-8465-4b8b-9c75-df746c203325]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:00 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:00 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:38:00 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:01 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.535s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.image.image_utils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Image conversion details: src /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc {{(pid=88466) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:38:01 devstack cinder-volume[88466]: INFO cinder.image.image_utils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Converted 1024.00 MB image at 249.49 MB/s Jul 23 03:38:01 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc is being set with open permissions: ugo+rw Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:01 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc Jul 23 03:38:01 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:01 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc" returned: 0 in 0.247s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" released by "_copy_volume_from_snapshot" :: held 5.699s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972-e7eade92-fe29-45d1-a164-40f1ed57a5cc" released by "_create_volume_from_snapshot" :: held 5.742s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.763s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.694s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot c5d14801-86a2-454f-a0d5-2e40c4ec89e1 of volume 3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67a3fb2-223f-426d-a51c-e1f5b813e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc', 'volume_size': 1, 'snapshot_id': 'a513d60f-f9e8-4cbc-8636-80ced1a71972'}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b7bff5-7883-47e9-85fc-a84015b85378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68eeb77-9bc9-4659-aeed-10cd5993883b]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:01 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Volume volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc (e7eade92-fe29-45d1-a164-40f1ed57a5cc): created successfully Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b7bff5-7883-47e9-85fc-a84015b85378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Flow 'volume_create_manager' (3cdd02da-eb37-4f5d-8c0a-6342155f5023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:01 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-fb3339e1-c888-4512-87a4-2b9c81f4c888 tempest-SnapshotDependencyTests-927196718 None] Created volume successfully. Jul 23 03:38:01 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 Jul 23 03:38:01 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:01 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09" returned: 0 in 0.366s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:01 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:01 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 1G Jul 23 03:38:01 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-a513d60f-f9e8-4cbc-8636-80ced1a71972-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-a513d60f-f9e8-4cbc-8636-80ced1a71972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Deleting offline snapshot a513d60f-f9e8-4cbc-8636-80ced1a71972 of volume dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] snapshot_file for this snap is: volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[83331ddb-fea7-4ea3-a0c3-d35119af409a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:02 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 1G" returned: 0 in 0.447s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:02 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 Jul 23 03:38:02 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:02 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:38:02 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:02 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1" returned: 0 in 0.300s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:02 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:02 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 is being set with open permissions: ugo+rw Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.387s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd69b85a-4930-4831-8ab8-c076b608088f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:02 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 Jul 23 03:38:02 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172fe66-a06d-4e9a-a60f-76463384fced]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:02 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:38:02 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:02 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:02 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:02 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info Jul 23 03:38:02 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:03 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.372s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:03 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:38:03 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:03 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info" returned: 0 in 0.272s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:03 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info is being set with open permissions: ugo+rw Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:03 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info Jul 23 03:38:03 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:03 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.358s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:03 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972 Jul 23 03:38:03 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:03 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.info" returned: 0 in 0.271s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-6a47f457-b87e-4543-83cd-b538c4d3d6b6 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:38:03 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f.a513d60f-f9e8-4cbc-8636-80ced1a71972" returned: 0 in 0.250s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-a513d60f-f9e8-4cbc-8636-80ced1a71972" released by "_delete_snapshot" :: held 1.466s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" released by "delete_snapshot" :: held 1.489s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Created reservations ['74d7f7a4-bad4-41ff-b515-4cbb8e79b5c0', 'bfbe3ced-2399-435c-966c-7ce57e8989bc', 'd9498be1-53a8-4b44-825b-9f4a080af9ce', 'c755d8f1-451b-42b5-889f-64cdb4a9abb8'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:03 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Delete snapshot completed successfully. Jul 23 03:38:03 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-23b23bb4-0c22-4310-8571-f5f50b7e36d8 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-a513d60f-f9e8-4cbc-8636-80ced1a71972-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-c5d14801-86a2-454f-a0d5-2e40c4ec89e1-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c5d14801-86a2-454f-a0d5-2e40c4ec89e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-c5d14801-86a2-454f-a0d5-2e40c4ec89e1" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c5d14801-86a2-454f-a0d5-2e40c4ec89e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot c5d14801-86a2-454f-a0d5-2e40c4ec89e1 of volume 3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a81437-e5a3-4105-9a1f-1d7b2ee6241e]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-dd69b85a-4930-4831-8ab8-c076b608088f-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-dd69b85a-4930-4831-8ab8-c076b608088f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" acquired by "delete_volume" :: waited 0.014s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:04 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 Jul 23 03:38:04 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[643edf4c-e72f-4cf2-bd83-2d8161feda83]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:04 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:38:04 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:04 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1" returned: 0 in 0.386s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21821f0-ac8d-4874-8af5-8d323083b67a]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:04 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.367s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:04 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:04 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 Jul 23 03:38:04 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:04 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f Jul 23 03:38:04 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:05 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-dd69b85a-4930-4831-8ab8-c076b608088f" returned: 0 in 0.246s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-dd69b85a-4930-4831-8ab8-c076b608088f" released by "delete_volume" :: held 0.666s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:05 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09" returned: 0 in 0.383s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:05 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 Jul 23 03:38:05 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Created reservations ['01f892d6-dfb9-492c-bcdc-0ef2d41c8471', 'cc2d1731-abc7-410f-be40-368a5efe6927', '997e6025-4491-4561-bb4e-6286b87e4501', '7802e642-246b-4925-900c-387bc53942a2'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:05 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:38:05 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:05 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1" returned: 0 in 0.355s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:05 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.276s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:05 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1 Jul 23 03:38:05 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Deleted volume successfully. Jul 23 03:38:05 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c12b732e-1020-47ed-86e8-a1c1dc00f696 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-dd69b85a-4930-4831-8ab8-c076b608088f-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-e7eade92-fe29-45d1-a164-40f1ed57a5cc-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-e7eade92-fe29-45d1-a164-40f1ed57a5cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[c760982a-41ff-4341-9e33-5ce68d1d77b3]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:05 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc Jul 23 03:38:05 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:05 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09.c5d14801-86a2-454f-a0d5-2e40c4ec89e1" returned: 0 in 0.303s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-c5d14801-86a2-454f-a0d5-2e40c4ec89e1" released by "_delete_snapshot" :: held 1.557s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" released by "delete_snapshot" :: held 1.586s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:05 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Created reservations ['ba79388f-7e4f-4ae2-a863-763f602fcbb2', '6d538dfe-d2cf-4194-9888-ababba5a3922', 'ef9e8392-0ba7-4c38-b623-16ddd03317e1', '2f1ec4b3-b4ae-4d8d-a026-498ddc77fa9c'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-71fafd7f-b358-432a-b6d2-5a59117285c1 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-c5d14801-86a2-454f-a0d5-2e40c4ec89e1-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:06 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc" returned: 0 in 0.410s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:06 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc Jul 23 03:38:06 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:06 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-e7eade92-fe29-45d1-a164-40f1ed57a5cc" returned: 0 in 0.245s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-quobyte-e7eade92-fe29-45d1-a164-40f1ed57a5cc" released by "delete_volume" :: held 0.700s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Created reservations ['56986ef0-ac83-4b5c-9db6-01af280d6c6a', '2f035ef7-b8dc-486d-9a92-ee0b4f398f39', '9a7316ea-75e5-4a22-aa48-88d68de26f1c', '058882c4-abc4-4007-ae09-b86ab21b0816'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-3f9e510a-d68d-457f-b0a6-b669e2b87d09-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "cinder-3f9e510a-d68d-457f-b0a6-b669e2b87d09-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:06 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:38:06 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" acquired by "delete_volume" :: waited 0.019s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[be510830-183b-460c-af51-d9e175ca57b6]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:06 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 Jul 23 03:38:06 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:06 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.279s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:06 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Deleted volume successfully. Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-5a7ad07c-b940-40ca-888c-eb487b0f1eb9 tempest-SnapshotDependencyTests-927196718 None] Lock "cinder-e7eade92-fe29-45d1-a164-40f1ed57a5cc-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:06 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09" returned: 0 in 0.391s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:06 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:06 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09 Jul 23 03:38:06 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:07 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-3f9e510a-d68d-457f-b0a6-b669e2b87d09" returned: 0 in 0.261s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-3f9e510a-d68d-457f-b0a6-b669e2b87d09" released by "delete_volume" :: held 0.714s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Created reservations ['8fd3a99b-f2ae-4058-b6ca-77233377aa78', '0880694c-7bb0-402e-8a02-a87d000efd04', '7c182415-03d0-457f-8729-8e25deb2cdd5', '2e6eb620-bb1f-4be9-844e-385ff5df5810'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:07 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:38:07 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:07 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.339s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:07 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:38:07 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-bb027662-98dd-42b3-ba80-be9f3b7b78cc tempest-ProjectMemberTests-1876011461 None] Lock "cinder-3f9e510a-d68d-457f-b0a6-b669e2b87d09-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.flows.manager.create_volume [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88466) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (25229024-af44-44cb-ab90-baf6dff64534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b9cb1-7cd4-42fd-abfa-f3ecef7b418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b9cb1-7cd4-42fd-abfa-f3ecef7b418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697719658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8de7276-c109-49a5-a78e-e05722cc243e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5733c192-aa0b-4944-9050-950b697db0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5733c192-aa0b-4944-9050-950b697db0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ebb563-fa6f-457d-bdab-ab8a99ff6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ebb563-fa6f-457d-bdab-ab8a99ff6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8de7276-c109-49a5-a78e-e05722cc243e', 'volume_name': 'volume-b8de7276-c109-49a5-a78e-e05722cc243e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d7b11b-0fb2-4bde-b2e3-df8668269431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d7b11b-0fb2-4bde-b2e3-df8668269431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e192e2f9-059c-4146-a862-9f0069da0183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:08 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Volume b8de7276-c109-49a5-a78e-e05722cc243e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8de7276-c109-49a5-a78e-e05722cc243e', 'volume_size': 1} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697719658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8de7276-c109-49a5-a78e-e05722cc243e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fe068077dd540399faf437b4a2bfa68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:38:08Z,use_quota=True,user_id='17f6359f85f445e09ed6f21a83b09e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7617df6b-13f7-4311-afe6-4f4b9b858522),volume_type_id=7617df6b-13f7-4311-afe6-4f4b9b858522)}" {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Creating volume b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Selected osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 as target Quobyte volume. {{(pid=88466) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:38:08 devstack cinder-volume[88466]: INFO cinder.volume.drivers.remotefs [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] casted to osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8 Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e 1073741824 {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:08 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e 1073741824 Jul 23 03:38:08 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:08 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e 1073741824" returned: 0 in 0.493s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:08 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:08 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e Jul 23 03:38:08 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:09 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e" returned: 0 in 0.255s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'} {{(pid=88466) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e192e2f9-059c-4146-a862-9f0069da0183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8de7276-c109-49a5-a78e-e05722cc243e', 'volume_size': 1}' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4069eeed-facf-4e0f-a1ff-eae9364b3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:38:09 devstack cinder-volume[88466]: INFO cinder.volume.flows.manager.create_volume [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Volume volume-b8de7276-c109-49a5-a78e-e05722cc243e (b8de7276-c109-49a5-a78e-e05722cc243e): created successfully Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4069eeed-facf-4e0f-a1ff-eae9364b3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88466) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:38:09 devstack cinder-volume[88466]: DEBUG cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Flow 'volume_create_manager' (25229024-af44-44cb-ab90-baf6dff64534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88466) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:38:09 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-2011f257-328c-430b-8e59-6f9fca8393c9 tempest-ProjectMemberTests-1876011461 None] Created volume successfully. Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Creating offline snapshot eeb98dc9-e37d-40cb-bb77-2b317ec2366d of volume b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1869}} Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8542be1-cd68-4eae-8d39-6af9f4bdb366]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:10 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e Jul 23 03:38:10 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:10 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e" returned: 0 in 0.408s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:10 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d 1G {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:10 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d 1G Jul 23 03:38:10 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d 1G" returned: 0 in 0.426s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de7276-c109-49a5-a78e-e05722cc243e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de7276-c109-49a5-a78e-e05722cc243e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d Jul 23 03:38:11 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8de7276-c109-49a5-a78e-e05722cc243e -F qcow2 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d" returned: 0 in 0.312s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d is being set with open permissions: ugo+rw Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d Jul 23 03:38:11 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:11 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d" returned: 0 in 0.270s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:11 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:11 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info Jul 23 03:38:11 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:12 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info" returned: 0 in 0.265s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:12 devstack cinder-volume[88466]: WARNING cinder.volume.drivers.remotefs [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info is being set with open permissions: ugo+rw Jul 23 03:38:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:12 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info Jul 23 03:38:12 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:12 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.info" returned: 0 in 0.264s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:12 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:12 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-1c11de26-2a0d-46c2-9d63-7b356761a4d3 tempest-ProjectMemberTests-1876011461 None] Create snapshot completed successfully Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-eeb98dc9-e37d-40cb-bb77-2b317ec2366d-delete_snapshot" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-eeb98dc9-e37d-40cb-bb77-2b317ec2366d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" by "delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-eeb98dc9-e37d-40cb-bb77-2b317ec2366d" by "_delete_snapshot" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-eeb98dc9-e37d-40cb-bb77-2b317ec2366d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Deleting offline snapshot eeb98dc9-e37d-40cb-bb77-2b317ec2366d of volume b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] snapshot_file for this snap is: volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[db444d5b-b240-4140-a21e-f9e2015f1141]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:13 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:13 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d Jul 23 03:38:13 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d" returned: 0 in 0.395s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.remotefs [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8de7276-c109-49a5-a78e-e05722cc243e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88466) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce9c64-22db-40b7-a963-f73b443191b0]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e Jul 23 03:38:14 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:14 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e" returned: 0 in 0.429s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:14 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:14 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d Jul 23 03:38:14 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:15 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d" returned: 0 in 0.346s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:15 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d Jul 23 03:38:15 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:15 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e.eeb98dc9-e37d-40cb-bb77-2b317ec2366d" returned: 0 in 0.273s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-eeb98dc9-e37d-40cb-bb77-2b317ec2366d" released by "_delete_snapshot" :: held 1.538s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" released by "delete_snapshot" :: held 1.591s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Created reservations ['75773c56-709d-4614-ba8c-170c07c2e6db', '6147cbf1-32f3-4e00-8a87-461188d04fd9', '9d77ed78-5e58-4da7-a711-22a9685433e0', '7e3be461-505d-4944-a217-e3760e718f12'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:15 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Delete snapshot completed successfully. Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-85fd0f6a-9eb3-4da8-b713-c719c540ab74 tempest-ProjectMemberTests-1876011461 None] Lock "cinder-eeb98dc9-e37d-40cb-bb77-2b317ec2366d-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-b8de7276-c109-49a5-a78e-e05722cc243e-delete_volume" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-b8de7276-c109-49a5-a78e-e05722cc243e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:15 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" by "delete_volume" {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" acquired by "delete_volume" :: waited 0.017s {{(pid=88466) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a16dc7-347e-4696-adf0-c7d3ef8f9162]: (4, 'qcow2') {{(pid=90379) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:16 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e Jul 23 03:38:16 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:16 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e" returned: 0 in 0.345s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:16 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e Jul 23 03:38:16 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:16 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f/volume-b8de7276-c109-49a5-a78e-e05722cc243e" returned: 0 in 0.252s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-quobyte-b8de7276-c109-49a5-a78e-e05722cc243e" released by "delete_volume" :: held 0.653s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG cinder.quota [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Created reservations ['1c5b7166-7f46-41a4-9939-b3883139637f', 'a482756d-126a-429a-81f2-c406ff4789d2', '5335906b-c4f7-4320-900b-486f5a6838bd', 'e9bc2252-0a76-4c8c-b94d-dec42830b136'] {{(pid=88466) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8': None} {{(pid=88466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b53e093b-95f4-4916-85d8-2972f4206bd8'] {{(pid=88466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.lockutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:38:16 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:38:16 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f Jul 23 03:38:16 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:38:17 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 23 03:38:17 devstack cinder-volume[88466]: DEBUG oslo_concurrency.processutils [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/541ea4a3ea1ab98362e54644cbd6e86f" returned: 0 in 0.254s {{(pid=88466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:38:17 devstack cinder-volume[88466]: DEBUG cinder.manager [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Notifying Schedulers of capabilities ... {{(pid=88466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:38:17 devstack cinder-volume[88466]: INFO cinder.volume.manager [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Deleted volume successfully. Jul 23 03:38:17 devstack cinder-volume[88466]: DEBUG cinder.coordination [None req-c2a3a2f9-98ae-4ae6-ab8f-634d3dd8930b tempest-ProjectMemberTests-1876011461 None] Lock "cinder-b8de7276-c109-49a5-a78e-e05722cc243e-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88466) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:38:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=103,cinder:UPDATE=103,cinder:INSERT=34,cinder:DELETE=8 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:38:32 devstack cinder-volume[88466]: DEBUG dbcounter [-] [88466] Writing DB stats cinder:SELECT=81,cinder:UPDATE=128,cinder:INSERT=29,cinder:DELETE=11 {{(pid=88466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}